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In  July  10/’:'  an  ASD  reserve  project  was  authorized  under  the  title  of 
•“Initial  Identif  ication  of  Project  Schedule  Elements,  Variables,  and 
Influences  for  Parametric  Schedul ing. "  This  project  was  to  be  done  In 
conjunction  with  the  AFSC/ASD  Initiative  16  for  the  development  of  an 
ASD  Independent  schedule  assessment  concept. 

However,  after  reviewing  the  data  collected,  and  considering  the  poten¬ 
tial  for  parametric  scheduling  use  at  ASD,  It  was  determined  that  the 
greatest  current  opportunity  existed  fur  assisting  ASD  In  the  planning 
and  scheduling  tasks  of  program  management. 

1.  Planning  and  Scheduling  definition:  What  Is  the  scope  of 
Planning  anJ  Scheduling  techniques  at  ASD? 

?.  Planning  and  Scheduling  ( P&S )  environment  at  ASD:  What  are  the 
proper  role;,  for  planning  and  scheduling  In  an  ASD  program  as  compared 
to  a  typical  industry  program? 

3.  Current  ASD  P&S  areas:  How  do  the  roles  of  the  Independent 
Schedule  Assessment,  the  Vanguard  System,  and  an  automated  management 
information  system  fit  into  the  P&S  function  at  ASD? 

4.  ASD  P&S  related  organizations :  What  organizations  are  currently 
doing  tasks  related  to  planning  and  scheduling  and  what  are  some  alter¬ 
natives  for  Improved  integration  and  coordination  of  the  P&S  functions? 

5.  Questions  for  Planning  and  Scheduling  Enhancement. 

Tne  answers  to  these  questions  should  aid  ASD  In  an  analysis  of  Its 
program  control  functions. 

Unlike  the  cost  area,  where  there  are  certain  recognized  organizations 
who  will  speak  out  with  some  degree  of  authority  to  protect  cost/budget 
integrity,  planning  and  scheduling  does  not  seem  to  have  such  a  central¬ 
ized  and  influential  advocate.  For  example,  the  Air  Force  Comptroller 
Office  provides  the  guidance  and  assistance  In  the  cost  area.  This  pro¬ 
vides  stability  of  organization  and  personnel  In  the  cost  control 
function.  Most  of  the  planning  and  scheduling  personnel  In  a  SPO 
program  management  office  are  usually  qualified  military  personnel  who 
are  somewhat  transient,  and  their  expertise  Is  lost  after  they  leave  that 
program  office. 

The  function  of  planning  and  scheduling  has  not  had  a  primary  organiza¬ 
tional  proponent  at  ASD  and,  therefore.  Its  role  Is  heavily  Influenced 
by  the  other  functions  and  organizations  to  which  It  Is  related.  It  Is 
most  usually  seen  as  adjunct  to  the  cost  control  function.  Most  of  the 
material  reviewed  in  th's  report  will  deal  with  It  In  that  context. 

ASD,  of  course,  operates  within  Department  of  Defense  policies  and 
procedures.  This  report  briefly  surveys  the  three  major  sub-functions 
in  the  planning  and  scheduling  area:  (a)  the  initial  planning  effort 
whicn  precedes  the  letting  of  the  contract,  (b)  the  contractors 
planning,  scheduling,  and  reporting  systems,  and  (c)  the  USAF  schedule 
surveillance  and  reporting  requirements. 


A)*>.)  reviewed  are  three  areas  of  interest  which  are  currently 
influencing  the  future  of  planning  and  scheduling  at  ASO.  They  are  the 
(1)  Independent  Schedule  Assessment  Program  (AFSC  Regulation  800-35), 
dated  31  January  1979,  produced  by  AFSC  Initiative  16-2,  (2)  the  AFSC 
initiative  project  Vanguard,  and  (3)  the  ASO  Automated  Management 
Systems  program  now  being  developed  by  the  ASD/ACP  organization. 

Planning  and  scheduling  Is  being  done  primarily  by  the  Deputy  for 
Development  Planning  (ASD/XR),  the  various  SPO  Program  Control 
organizations,  and  the  Contract  Management  Division  (CMD).  They  are 
supported  In  this  function  by  the  Controller  (ASD/AC)  organizations,  the 
Program  Costs  Directorate,  Cost  Analysis  Directorate,  and  the  Deputy 
for  Contracting  and  Manufacturing.  These  organizations  and  their  rela¬ 
tionship  to  the  planning  and  scheduling  function  will  be  reviewed. 

At  the  close  of  this  report  the  planning  and  scheduling  related  organiza¬ 
tions  are  asked  certain  questions  basic  to  that  discipline.  They  are  pro¬ 
posed  for  self-testing  of  the  function.  Responses  received  will  be  used  in 
making  constructive  recommendations  for  the  overall  integration  and  coor¬ 
dination  of  planning  and  scheduling  at  ASD. 

The  questions  asked  that  are  common  to  all  organizations  are; 

1.  Do  the  top  managers  and  staff  of  each  of  these  organizations  have 
readily  available  the  current  schedule  dates  and  schedule  status  of  the 
major  milestones  of  the  program  which  are  Included  In  their  operational 
responsibility? 

2.  How  compatible  are  the  planning  and  scheduling  policies  and  proce¬ 
dures  among  these  organizations? 

3.  Is  any  one  officer  at  ASO  reviewing,  even  at  a  sum nary  level,  the 
quality  of  the  planning  and  scheduling  support  that  Is  necessary  Including 
the  CMD/ AF PRO  support? 

Ten  other  questions  are  asked  of  applicable  organizations. 

ASD  has  a  good  opportunity  at  this  particular  time  to  assess  Its  planning 
and  scheduling  operation  and  make  meaningful  Improvements  to  such  functions 
as  the  "Independent  Schedule  Assessment,*  “Vanguard,*  and  “Automated 
Management  System.*  In  the  spirit  of  this  recommendation,  this  report  con¬ 
cludes  with  the  beginning  of  a  follow-on  reserve  project  which  will  review 
questions  raised  with  ASD  managers,  &nd  prepare  specific  recommendations 
for  planning  and  scheduling  enhancement  ip  the  above  three  functions. 

Planning  and  scheduling  is,  of  course,  time  management.  Time  Is  not  only 
money,  but  for  the  Air  Force  It  Is  also  national  security.  If  this  study 
can  contribute  to  greater  savings  and  earlier  performance.  Its  contribution 
should  be  meaningful. 
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Introduction 


In  December  1977  a  Headquarters  AFSC  study  group  convened  at  ASD  to  review 
how  the  division  does  Its  business.  One  of  the  Initiatives  which  resulted 
from  this  review  was  known  as  Initiative  16.  The  description  of  this 
initiative  was  as  follows: 

■Objective  Is  to  define/ Improve  schedule  assessment  processes 
so  that  'realism  of  program  schedule  achievement1  is  more 
accurately  evaluated.  Task  is  to  develop  a  standardized 
method  for  verifying  the  accuracy  of  program  schedules  being 
priced  by  independent  cost  assessment  (ICA)  teams.  Antici¬ 
pated  output  of  this  study  is  a  draft  guide  for  the  conduct  of 
independent  schedule  assessments  which  are  compatible  with 
and  related  to  Independent  cost  assessments."  (1) 

In  response  to  this  initiative,  team  committees  were  established  at  ASD 
and  CMD  to  consider  the  AFSC  recommendations.  Inquiry  was  made  through  the 
Air  Fo~ce  Business  Research  Management  Center  at  Wright-Patter^on  Air  Force 
Base,  Ohio,  to  utilize  ASD  reserve  officers  and  their  military  an.-'  civilian 
professional  experience  In  related  fields  of  this  initiative. 

The  task  of  this  project  started  out  in  July  of  1978  to  provide 
assistance  to  tne  Initiative  16  effort.  This  Included  an  initial  review  of 
typical  program  schedule  documentation,  discussion  with  some  program  staff 
members,  and  the  application  of  extensive  professional  experience  concern  in 
the  elements,  variables,  and  influencing  factors  which  would  provide  initial 
material. 

On  31  January  1979,  as  a  result  of  the  ASD  Initiative  16  teamwork, 

AFSC  Regulation  800-39  was  issued  entitled  the  Independent  Schedule 
Assessment  Program.  Also,  a  draft  guide  was  prepared  for  Hq  AFSC  review  and 
follow-on. 

As  the  Initiative  16  effort  was  reflected  in  the  Independent  Schedule 
Assessment  (ISA)  Regulation  and  draft  guide,  a  new  question  became  apparent. 
This  was  the  question  concerning  the  scope  of  actual  implementation  of  an  ISA 
In  the  current  ASD  program  management  environment.  There  was  another 
planning  and  scheduling  endeavor  which  was  already  in  effect  within  ASD  known 
as  Vanguard.  The  purpose  of  the  Vanguard  project  was: 

“to  provide  Integrated  program  planning  for  explanatory, 
advanced,  and  engineering  development.  Plans  will  be 
developed  to  describe  activities  for  each  mission  area  and 
will  provide  three  perspectives--mission  area,  mission  force 
element,  and  functional.  Plans  will,  in  general,  include  a  base 
line  based  on  analysis  and  assessments."  (2) 

Another  significant  development  for  planning  and  scheduling  has  been  the 
Implementation  of  an  automated  management  system.  The  Director  of  Program 
Control  (ACP)  was  given  this  responsibility  which  is  described  as: 
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"Design,  development,  test,  and  Implementation  of  automated 
management  system  for  use  In  all  aspects  of  acquisition 
program  management  at  all  levels  in  ASD  up  through  Commander, 

ASD,  level.  Integration  of  boldly  developed  systems  with 
systems  directed  by  higher  headquarters  and  further  wide 
definition  of  authority  throughout  ASD."  (14) 

In  Figure  0-1  the  relative  role  of  the  systems  which  relate  to  planning 
and  scheduling  are  illustrated.  Vanguard  identifies  the  Master  Plan  for 
AFSC.  Contract  schedule  requirements  which  specify  detail  contractor  support 
requirements  through  the  CMD/AFPRO  or  direct  to  the  SPO.  The  ASD  management 
systems  for  the  Program  Control  functions  snculd  assist  in  the  necessary 
interface  and  interflow  for  program  data  between  contract  and  AFSC  as  well 
as  providing  all  levels  of  ASD  management  mid-level  planning  and  analysis 
capability.  These  scheduling  requirements.  Initiative  16,  ISA,  the  data 
management  system,  and  Vanguard  offered  a  new  and  significant  opportunity  to 
the  ASD  program  management  including  the  specific  organizations  discussed  in 
detail  in  Section  IV. 


Reserve  Project  Background 


In  July  1978  an  ASD  reserve  project  was  authorized  under  the  title  of 
"Initial  Identification  of  Project  Schedule  Elements,  Variables,  and 
Influences  for  Parametric  Scheduling."  This  project  was  to  be  done  in  con¬ 
junction  with  the  AFSC/ASD  Initiative  16  for  the  development  of  an  ASD  inde¬ 
pendent  schedule  assessment  concept. 

The  ASD  reserve  project  effort,  being  limited  to  one  person,  was 
only  able  to  track  this  effort  and  benefit  from  the  collection  of  related 
data  at  ASD  (Wright-Patterson)  and  CMD  (Kirtland  AFB).  The  initial  goal 
of  this  project  was  to  look  at  a  specific  approach  to  schedule  assess¬ 
ment  through  parametric  scheduling.  This  form  of  scheduling  uses  his¬ 
torical  data  from  technical  quantifications  compared  to  their  related 
schedule  durations  to  predict  project  schedules  or  to  assess  schedules 
that  nave  been  proposed. 

however,  after  reviewing  the  data  collected,  and  considering  the  poten¬ 
tial  for  parametric  scheduling  use  at  ASD,  it  was  determined  that  the 
greatest  current  opportunity  existed  tor  assisting  ASD  in  the  planning  and 
scheduling  tasks  of  program  management. 

As  a  result  this  project  has  been  designed  to  provide  an  evaluation  of 
the  function  of  Planning  and  Scheduling  at  ASD  and  will  be  the  focus  of  this 
report.  The  primary  questions  which  will  be  answered  by  this  report  are: 

1.  Planning  and  Scheduling  definition:  What  is  the  scope  of  Planning 
aid  Scheduling  techniques  at  ASD? 

2.  Planning  and  Scheduling  (P&S)  environment  at  ASD:  What  are  the 
proper  roles  for  planning  and  scheduling  in  an  ASD  program  as  compared  to  a 
typical  industry  program? 


FIGURE  0-1 


3.  Current  ASD  P&S  areas:  How  ac  the  roles  of  tne  Independent  Schedule 
Assessment,  the  Vanguard  system,  and  ar  automated  management  Information 
system  fit  Intc  the  P&S  function  at  ASD? 

4.  ASD  P&S  related  organizations:  What  organizations  are 
currently  doing  tasks  related  to  planning  and  scheduling  and  what  are 
some  alternatives  for  improved  integration  and  coordination  of  the  PiS 
functions? 


5.  Questions  for  Planning  and  Scheduling  Enhancement. 

The  answers  to  these  questions  should  aid  ASD  in  an  analysis  of  Its 
program  control  functions. 


Current  ASD  Planning  and  Scneduling  Update 

The  changing  systems  environment  at  ASD  makes  any  type  of  report  of 
limited  long  range  value.  It  is  necessary  to  add  to  this  report  some  recent 
developments,  which  will  not  be  referenced  in  the  balance  of  the  report. 


ASD  1980  reorganizations  seemed  to  have  given  new  highlight-' 
Program  Control  function.  The  Comptrollers  Program  Control  Dir 
(ACP)  has  matrix  staffing  responsibilities  for  all  the  system  d. 
their  related  Program  Control  directorates.  FFR  is  also  respon? 
training  Program  Control  people,  but  also  providing  standard  mar 
systems.  SMART-D  is  referred  to  in  this  report  elsewhere,  but 
on  overall  system.  INFOCEM  is  being  replaced  with  BASIS,  about  > 
data  is  now  available.  BASIS,  like  INFOCEM,  includes  CPM  capabi . . 
(Critical  Path  network  concept). 
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The  increasing  role  of  FFR  Program  Control  in  providing  planning  and 
scheduling  systems  and  program  control  training  is  giving  added  emphasis  to 
this  function  at  ASD. 
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I.  PLANNING  AND  SCHEDULING  DEFINITION 


Planning  and  Scheduling  (P&S)  is  a  management  function  related  to  the 
planning  of  a  job  in  task  sequence  and  determining  the  applicable  resources, 
time  durations  and  subsequent  schedule  dates.  This  function  will  then 
Include  the  collection  of  data  required  to  determine  the  amount  of  regress 
achieved,  resources  remaining,  work  remaining  including  changes,  anc  any 
evaluations  or  assessments  of  what  the  current  information  says  about 
planned  schedule  achievement. 

Schedules  are  subject  to  many  variables.  Some  of  these  variables 
are  as  follows: 

a.  A  schedule  is  based  upon  the  management  of  time,  which  can  be 
a  very  personal  characteristic.  Time  management  will  vary  greatly 
depending  on  how  the  workers  and  management  understand  the  task,  how 
they  are  motivated,  and  how  fast  they  can  function,  mentally  and 
physical ly. 

b.  Schedules,  unlike  costs,  cannot  usually  be  tied  as  easily 
to  some  current  market  value.  While  the  market  conditions  a~e  con¬ 
tinually  seen  clearly  In  costs,  the  schedule  variations  which 
affected  by  such  conditions  are  harder  to  identify. 

c.  Every  company  and  organization  has  a  different  management 
■personality."  That  personality  is  affected  by  its  previous  ways  of  doing 
business  as  well  as  the  preferences  of  its  current  management  and  their 
policies  and  procedures.  This  affects  such  areas  as  resource  allocation  and 
cost  to  schedule  trade-offs. 

d.  Competitive  constraints  will  sometimes  limit  schedule  alternatives. 
Under  these  pressures,  it  may  be  hard  for  management  to  remain  realistic 

in  their  schedu’e  decisions.  It  is  often  too  easy  so  set  aside  schedule 
considerations  for  short  term  relief  or  benefit. 

The  development  of  schedules  must  take  these  subjective  and  sometimes 
Intangible  variables  into  account  when  any  kind  of  schedule  assessment  is 
made. 

In  the  Air  Force's  situation,  part  of  the  problem  is  the  assignment 
of  a  project  to  many  organizations  and  mission  interests.  Unlike  the  cost 
area,  where  there  are  certain  recognized  organizations  who  will  speak  out 
with  some  degree  of  authority  to  protect  cost/budget  integrity,  planning, 
and  scheduling  does  not  seem  to  have  such  a  centralized  and  Influential 
advocate.  For  example,  the  Air  Force  Comptroller  Office  provides  the 
guidance  and  assistance  In  the  cost  area.  This  provides  stability  of  organi¬ 
zation  and  personnel  in  the  cost  control  function.  Most  of  the  planning 
and  scheduling  personnel  In  a  SPO  program  management  office  are  usually 
qualified  military  personnel  who  are  somewhat  transient  and  their  expertise 
is  lost  after  tney  leave  that  program  office. 

Finally,  planning  and  scheduling  is  a  field  where  there  are  many  real 
and  self-appointed  experts,  and  many  of  these  are  strong  advocates  of  their 
own  position.  This,  coupled  with  the  sensitivity  of  schedules  to  project 
management,  causes  real  problems  when  there  is  not  a  single  v.'re  heard 
clearly  on  the  subject  minimizing  unnecessary  debate  and  uncertc  -  d'^ectlon 
and  redirection. 
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II.  TS£  PLANNING  AND  SOLD  JUNG  ENVIRONMENT  AT  Abb 


The  function  of  planning  am  scheduling  L P&S ;  nas  net  had  a  single  organ 
zational  proponent  at  ASO  and,  therefore,  its  role  is  heavily  influenced 
by  tne  ether  functions  a, no  organizations  to  which  it  is  related,  it  is  most 
usually  seen  as  adjunct  to  the  cost  control  function.  Most  all  cf  the 
material  reviewed  in  this  report  will  ceal  with  it  in  that  context. 

AST,  of  course,  operates  within  Dcoa'tnvnt  of  Defense  policies  and 
procedures.  There  are  three  major  s„:-furcf io-'S  m  tne  planning  and  sche¬ 
duling  are  a:  (a)  the  initial  plannin.  effort  -n.cn  preceeds  tne  letting  of 
the  contract,  (b)  the  contractors  plan:  r^.  scheduling,  and  reporting 
systems,  and  (c)  tne  wSAf  schedule  su: veil  lance  and  reporting  requirements. 
Tne  various  GOD  requirements  for  planning  and  scheduling  have  beer,  iden¬ 
tified  as  follows: 


"Application  cf  standard  reporting  requirements  to  new  programs 
is  accomplished  on  a  selective  Dasis.  Program  managers  are 
encouraged  to  tailor  reports  to  meet  t«eir  neuos  and  suit  the 
oecuiiur  characteristics  of  tneir  program..  Tailoring  normally 
means  reducing  requirements  rather  than  adding  additional 
reporting  elements;  and  it  is  DOD  policy  to  hold  reporting 
requirements  to  tne  minimum  essential  to  support  program 
management  needs. 

The  Contract  Funos  Status  Report  (CFSR)  has  the  lowest 
tnreshold  for  application.  The  CFSR  is  applicable  to  con¬ 
tracts  over  $500,000  in  value.  Tne  Cost/Scnedule  Status 
Retrrt  (C/SSR)  and  portions  of  the  Contractor  Cost  Data 
Reporting  system  (CCOR)  are  also  applicable  to  contracts  over 
$2  million.  On  selected  contracts  within  major  programs,  the 
Cost  Performance  Report  (CPR)  replaces  the  C/SSR,  additional 
elements  of  CCQR  are  required,  and  the  contractors1  systems  must 
meet  the  Cost/Schedule  Control  Systems  Criteria  (C/SCSC)."  (3) 

Figure  1 1 -1  illustrates  these  relationships. 

The  official  DOC  policy  documents  wnich  address  performance  measurement 
systems  requirements  and  associated  performance  reporting  are  DOD 
Instructions  7000.2  and  7000.10.  This  brochure  and  similar  materials  on  the 
subject  of  cost/schedule  performa.ee  measurement  can  be  obtained  directly 
from  the  Directorate  for  Major  Acquisition  Management  Systems,  OSD 
(Comptroller),  The  Pentagon,  Washington,  D.C.  20301. 


These  reporting  specifications  do  not  preclude  the  preparation  of  other 
contracts  scheduling  requirements  by  tne  SPO  who  may  request  more  direct 
Involvement  in  the  contractor  systems  management.  With  the  Increase  of 
fixed  price  controls  most  contract  scheduling  requirements  have  been  dif¬ 
ficult  to  implement. 


Assistant  Secretary  of  Defense  Schedule  &  Cost  Measurement  Requests 


The  office  of  Assistant  Secretary  of  Defense  has  established  the 
following  requirements  for  schedule  and  cost  performance  measurement: 


FIGURE  JI-1 

REQUIREMENTS  APPLICABILITY 


"As  a  minimum,  a  quod  pt’^ormarce  report  must  be  able  to 
answer  the  question,  'Where  are  v.e  now?'  in  a  clear,  unequivocal 
manner.  Unfortunately,  many  cost  and  schedule  reports  currently 
in  use  cannot  adequately  answer  this  question  due  to  a  lack  of 
integration  of  cost  and  schedule  data.  Integration  of  cost  and 
schedule  Information  is  required  to  eliminate  much  of  the  sub¬ 
jectivity  with  which  the  cost  performance  is  determined.  To 
Illustrate  this  point,  consider  the  manager  who  has  to  work  with  a 
report  which  compares  actual  costs  to  budgets  and  a  separate  report 
plannee  versus  actual  schedule  status.  If  tne  project  is  right 
on  oudget,  out  is  behind  schedule,  it  is  prooably  overrunning. 
Quantifying  tne  cost  attributable  to  tr.e  schedule  deviation 
can  be  virtually  impossible  or,  at  bc^t,  highly  subjective. 

If,  however,  budgets  are  related  directly  to  schedule  incre¬ 
ments  of  work,  mucn  of  the  subjectivity  can  be  eliminated.  An 
objective  report  of  work  accompl ishment  will  then  provide  a 
basis  for  determining  meaningful  cost  performance.  Overall 
schedule  performance  can  also  be  viewed  in  dollar  terms  by  simply 
comparng  budgets  for  completed  work  to  budgets  for 
schedulea  work. 

The  best  place  to  measure  accomplishment  is  at  the  level  where 
work  is  performed.  Simple  summaries  Dy  organizational  unit  or 
work  breakdown  structure  elements  can  provide  upper-level 
managers  with  information  which  is  aggregated  in  a  meaningful 
form  to  facilitate  management  by  exception  and  Keeps  the 
amount  of  information  reported  to  higher  levels  to  a  minimum. 

Tne  management  system  which  produces  these  reports  must  be 
reasonably  well  disciplined  to  be  effective.  Arbitrary  trans¬ 
fers  of  budget  from  one  task  to  another,  for  example,  can 
destroy  the  significance  of  reported  values. 

The  Cost/Schedule  Control  Systems  Criteria  (C/SCSC)  of  DODI 
7000.2  set  forth  many  of  the  characteristics  and  disciplines 
required  of  an  effective  performance  measurement  system. 

These  criteria  do  not  impose  any  specific  management  technique 
or  methodology,  but  represent  basic  principles  applicable  to 
most  management  systems.  Failure  to  meet  a  criterion 
generally  indicates  a  weakness  in  a  cost/schedule  control 
system.  While  compliance  with  the  C/SCSC  is  mandatory  on 
major  defense  programs,  the  criteria  also  provide  a  useful 
checklist  for  evaluating  programs  of  any  size."  (4)  (Special 
attention  should  be  given  this  last  sentence  and  it  will  be  noted 
again) 

DOD  policies  and  directives  have  specified  that  to  have  a  good  measure¬ 
ment  one  must  also  have  good  definition.  The  following  requirements  have 
been  identified  accordingly: 

A.  Define  the  Work.  A  thorough  definition  of  all 
aspects  of  the  contractual  effort  is  essential  to  the 
establishment  of  a  good  performance  measurement  plan. 

Work  Identification  can  be  facilitated  by  using  a 
product  or  work  breakdown  structure  to  progressively 


identify  each  element  of  the  Item  to  be  produced  as  well 
as  the  activities  required  to  accomplish  the  effort. 
While  such  a  breakdown  or  product  explosion  is  commonly 
used  In  manufacturing,  it  is  usually  more  difficult  to 
establish  In  engineering  where  the  tendency  is  to 
describe  the  effort  in  broad  general  terms,  identifying 
only  near-term  effort  in  detail.  This  lack  of  work 
definition  can  easily  lead  to  downstream  surprises  on 
projects  which  appear  to  be  doing  well  simply  because  it 
is  virtually  impossible  to  determine  resources  required 
for  ill -defined  work. 

B.  Schedule  Activities.  Scheduling  is  an  important  and 
Integral  part  of  the  overall  planning  effort  as  the 
scheduling  process  forces  people  to  quantify  their 
effort  In  discrete  terms  and  to  place  tasks  in  proper 
relationship  to  each  other.  Since  outside  schedule 
constraints  may  be  dictated  by  contractual  delivery 
dates,  facility  limitations  or  other  external  factors, 
the  planning/scheduling  functions  are  usually  iterative 
in  nature  In  order  to  provide  for  accomplishment  of  all 
required  tasks  within  the  specified  time  frames. 

C.  Allocate  Resources.  Once  the  contractual  effort  is 
defined  and  scheduled  to  the  maximum  possible  extent, 
resources  for  accomplishing  the  work  must  be 
established,  usually  through  the  internal  budgeting 
process.  While  scheduling  is  an  iterative  process  in 
order  to  arrange  for  all  the  work  within  prescribed  time 
limits,  budgeting  is  also  an  iterative  process  in  order 
to  provide  for  accomplishing  the  work  within  pre¬ 
determined  funding  limits.  In  the  case  of  company 
funded  work,  management  establishes  cost  targets  which 
form  the  basis  for  the  internal  budget.  For  contractual 
effort,  the  negotiated  contract  cost  usually  serves  as 
the  target  and  the  point  of  departure  for  the  budget. 

In  order  to  measure  contract  cost  performance,  it  is 
Important  that  internal  budgets  sum  to  the  contract 
target  cost  so  that  the  relative  value  of  completed  work 
can  be  determined."  (4) 


See  Figure  1 1-2 

The  preceedlng  remarks  partially  explain  the  environment  which  DOD  would 
expect  ASO,  and  CMD,  to  be  working  within.  SPO  management  emphasis  should 
be  seeking  to  achieve  these  ideals  in  program  management. 

ASP  Program  Influence  Factors 

One  of  the  Initiative  16  Team  reports  included  this  outline  of  factors 
which  impact  a  typical  ASD  program.  These  factors  in  turn  influence  schedule 
and  cost  control. 
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FIGURE  1 1-2 

WORK-BUDGET-SCHEDULE  1 NTEGRAT I  ON 


Factors  that  Impact  on  the  Development  of  Program  Schedule  and 
Network  at  ASD.  (1) 
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GROUPINGS 

FACTORS 

A. 

Program  (Example) 

Typical  Aircraft  Production  Rate 

B. 

Program  Control  Point 

1. 

First  Hardware  Delivery 

2. 

Maximum  Production  Rate  Achieved 

3. 

Initial  Operating  Capability  (IOC) 

4. 

Program  Management  Responsibility 
Transfer  (PMRT) 

C. 

Event/Activities 

1. 

Release  of  Mission  Element  Need 
Statement  (MENS) 

2. 

Program  Authority  Received 

3. 

Program  Strategy  Established 

4. 

Work  Breakdown  Structure  Prepared 

5. 

Program  Decision 

6. 

Release  of  RFP 

7. 

Start  of  Source  Selection 

8. 

Contract  Award 

9. 

Reviews  and  Audits 

10. 

Test  Programs 

D. 

Physical /Performance 

1. 

Primary  Factors: 

Factors  a.  Thrust 

b.  Velocity 

c.  Attitude 

d.  Acceleration 

e.  Range 

f.  Weaponry/Payload  (useful  load) 

g.  Operating  Characteristics  Factors 

h.  Advance  Development  Factor 

i.  System  Complexity  Factor 

2.  Secondary  Factors: 

a.  Size 

b.  Weight 

c.  Number  of  Engines 

d.  Maximum  Surface  Temperature 

e.  Availability  of  Facilities 


E.  Correlated  Events  that  May  Not  Be  Totally -Controllable 
could  impact  Program 

Schedule  (Activities  or  a.  Funding 

factors  that  may  not  be  b.  Requirements  redirection 

totally  controllable  by  c.  Program  priority 

the  SPO  or  contractor)  d.  Economic  conditions 

e.  GFE  vs  CFE 


II.  GROUPING 


SCHEDULE  INFLUENCE  FACTORS 


A.  Engineering  Design 


1.  System  Complexity 

2.  State-of-Art  Extension 

3.  Management  Control/Integration 

4.  Contract  or  Design  Experience 

5.  Procurement  Strategy 

6.  Software  Development 

7.  Configuration  Contol  &  Stability 


8.  Prototype 
Fabrication 


1.  Related  Manufacturing  Experience 

2.  Manpower/Skills 

3.  Materials  Availability 

4.  New  M  &  P  Technology 

5.  Project  Management 

6.  Number  Critical  Subcontractors 

7.  Subcontractor  Performance 

8.  Government  Furnished  Equipment  Support 

9.  Contractor  Facilities  &  Equipment 

10.  Drawing  Release 

11.  Integration  Requirements 

12.  Subsystem  Qualification  Tests 


C.  Production  First 
Article 


0.  Model  Test  and 
Evaluation 


1.  Related  Manufacturing  Experience 

2.  Manpower/Skllls 

3.  Design  Stability 

4.  Procurement  Strategy 

5.  Contract  Facilities  &  Equipment 

6.  Acceleration  to  Rate  Requirements 

7.  Number  of  Critical  Subcontractors 

8.  Subcontractor  Performance 

9.  Government  Furnished  Equipment  Support 

10.  Integration  Requirements 

11.  Drawing  Release 

12.  Project  Management 

13.  Contractor  Management  Systems 

14.  System  Qualification  Test 

1.  Test  and  Facility  Availability 

2.  Test  Support  Software 

3.  Model  Fabrication 

4.  State-of-Art  Extension 


E.  Gun  and  Ammo 

Qualification  Tests 


1.  Test  Facility  Availability 

2.  Data  Reduction/Evaluation 

3.  Number  Test  Events 

4.  Failure  Analysis 


(1) 


ASP  Schedule  Constraints 


Schedule  constraints  from  both  the  contractor  and  the  SPO 
can  have  a  significant  impact  on  the  contractor’s  ability 
to  successfully  meet  the  program  schedule.  Through  effec¬ 
tive  management  the  milestones  are  established  and  resources 
allocated  which  lead  to  successful  completion  of  the 


project.  However,  there  are  several  factors  which  will 
Impact  schedules  and  are  beyond  the  capability  of  the  SPO 
or  contractor  to  directly  influence.  Schedule 
constraints,  therefore,  are  divided  into  two  categories: 
Controllable  -  those  factors  that  the  contractor  or  SPO 
can  have  a  direct  Impact  on  and  uncontrollable  or  those 
factors  which  neither  the  contractor  or  the  SPO  can 
directly  Impact. 

A.  Controllable  -  SPO  management  and  administrative 
milestones.  The  program  manager  and  his  subordinates  must 
establish  milestones  which  are  measureable  and  meaningful. 
Little  is  accomplished  if  milestones  are  established  which 
cannot  be  accurately  measured  against  a  completed 
activity.  Since  milestones  are  by  definition  a  management 
check  point,  the  measurability  and  meaningful  ness  of  the 
milestones  are  an  all  Important  factor.  Little  is  gained 
if  the  milestone  lacks  a  significant  meaning  or  the  ability 
to  be  measured.  The  milestones  should  include  significant 
program  management  milestones  such  as  completion  of  the 
program  reviews.  This  helps  to  assure  that  adequate  time 
exists  for  advanced  planning  and  preparation  1eading  to 
the  review.  The  major  administrative  milestones  must  also 
be  factors  Into  the  overall  schedule.  This  will  assure 
that  when  the  timing  of  each  major  milestone  is  firmly 
established  that  the  administrative  leadtimes  have  been 
considered.  In  addition,  without  identification  of  the 
adnlnl strati ve  milestones,  times  spans,  often  consuming 
several  months  preceding  and  following  a  milestone  may  not 
have  a  check  point  for  controlling  the  program.  One  such 
milestone  is  the  release  of  the  RFP  which  culminates 
months  of  effort  preparing  the  statement  of  work,  the 
model  contract,  and  instructions  to  offerors.  The  RFP 
release  Is  then  followed  by  months  of  contractor  effort 
preparing  a  response. 

B.  Uncontrollable  -  Successful  completion  of  the  events  and 
activities  identified  above  may  be  influenced  by  factors 
some  of  which  may  not  be  totally  controllable  by  the  SPO 

or  contractor.  The  factors  are: 

1.  Funding.  Deviations  from  the  original  planned 
funding  profile  may  result  in  variations  in  the  schedule. 
Funding  cuts  will  extend  the  schedule  and  an  increase  may 
result  In  compression  of  the  schedule. 

2.  Requirements  Redirection.  A  change  in  the  per¬ 
ceived  nee'i  or  funding  levels  may  require  the  addition  or 
deletion  of  some  requirements.  Depending  on  the  stage  of 
development  or  production  a  change  in  schedule  might  be 
required  to  accommodate  the  change. 
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3.  Program  Priority.  Tne  prio,*";y  cf  ;he  program  may 
have  a  significant  influence  cr.  the  schedule.  A  low 
priority  program  will  be  more  susceptible  to  budget  cuts. 
In  addition,  a  low  priority  program  may  nave  difficulty 
obtaining  adequate  range  time  for  the  test  program. 

Either  budget  cuts  or  lack  of  range  time  will  delay  the 
development  schedule  and  may  result  In  concurrent  develop¬ 
ment  and  production  or  a  slip  of  the  production  start 
date."  (1) 


In  orcer  to  r ancle  these  factors  ar.o  manage  the  performance  of  their 
programs,  one  project  office,  ASO/AE,  identified  an  extensive  number 
of  reviews  that  are  required. 


Cost/Schedule  Control  Systems  Criteria 

Some  major  programs  are  required  to  use  the  Cost/Schedule  Control 
Systems  Criteria  (C/SCSC)  In  following  DOD  Instruction  7000.2.  C/SCSC 
is  a  good  example  of  Planning  and  Scheduling  (P&S)  criteria  whether  the 
system  is  used  or  not.  A  review  of  tne  background  statement  Included  is  an 
important  part  of  the  P&S  environment  required  for  ASD  SPO  management 
activities  The  following  is  an  excerpt  from  AFSCP/AFLCP  173-5  dated 
1  October  1976. 

''1-2.  Background. 

a.  Management  Needs.  A  fundamental  responsibility  in  the 
acquisition  and  modification  of  major  weapon/support  systems 
is  to  ensure  that  visibility  of  contractors'  progress  is  suf¬ 
ficient  to  indicate  reliably  the  results  being  obtained,  in 
carrying  Out  this  responsibility  in  selected  contracts  within 
applicable  Defense  pregrams,  DOD  receives  and  reviews  cost  and 
schedule  performance  data.  To  be  meaningful  these  data  must: 

(i)  portray  budgets  allocated  overtime  to  specific  contract 
tasks;  (2)  indicate  work  progress;  1 3)  properly  relate  cost, 
schedule,  and  technical  accomplishment;  (4)  be  valid,  timely, 
and  auditable;  and  (b)  supply  DOD  managers  with  a  practical 
level  o~  sumnarizatior,.  Such  data  should  be  derived  from  the 
same  Internal  management  control  systems  as  used  by  the 
contractor  to  manage  his  contract  effort. 

0.  Criteria  Concept.  It  Is  recognized  that  no  single 
common  set  of  management  control  systems  will  meet  every  DOD 
anc  contractor  management  data  need  for  performance 
measurement.  Due  to  variations  In  organizations,  products, 
and  working  relationships,  it  Is  not  feasible  to  prescribe  a 
universal  system  for  cost  and  schedule  controls.  DOD  has 
adopted  an  approach  which  simply  defines  the  criteria  that 
contractors'  management  control  systems  must  meet.  The  cri¬ 
teria  provide  the  basis  for  determining  whether  contractor 
management  control  systems  are  acceptable. 

(1)  The  responsibility  for  developing  and  applying 
the  specific  procedures  for  complying  with  these  criteria  Is 
vested  In  the  contractor,  but  the  specific  management  control 
systems  he  proposes  are  subject  to  DOD  acceptance.  In  instances 
where  the  contractor's  systems  do  not  meet  the  criteria, 
necessary  adjustments  to  achieve  compliance  will  be  required. 
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(2)  By  applying  criteria,  rather  than  specific  DOD 
prescribed  management  control  systems,  contractors  have  the 
latitude  and  flexibility  for  meeting  their  unique  management 
needs.  This  approach  allows  contractors  to  use  existing  man¬ 
agement  control  systems  or  other  systems  of  their  choice,  pro¬ 
vided  they  meet  the  criteria. 

(3)  When  the  solicitation  document  (request  for 
proposal,  request  for  quotation,  and  the  like)  specifies 
application  of  the  criteria,  an  element  in  the  evaluation  of 
proposals  will  be  the  prospective  contractor's  proposed 
systems  for  planning  and  controlling  contract  performance. 

The  prospective  contractor  will  describe  the  systems  to  be 
used  In  sufficient  detail  to  permit  their  evaluation  for 
compliance  with  the  criteria. 

(4)  If  awarded  the  contract,  the  contractor  will  be 
required  to  have  a  comprehensive  description  of  the  management 
control  systems  and  demonstrate  to  a  Government  C/SCSC  review 
team  their  effective  application  in  planning  and  controlling 
the  work  under  the  contract.  000  relies  on  the  contractor's 
systems  when  they  are  accepted  and  does  not  superimpose  cud  li¬ 
cet  ive  planning  and  control  systems. 

(5)  Contractors  having  systems  previously  accepted  are 
encouraged  to  maintain  the  essential  elements  and  disciplines 
of  the  systems.  If  they  intend  to  remain  in  the  competitive 
environment  for  future  defense  contracts  involving  large 
acquisition  programs."  (6) 

The  C/SCSC  did  not  seek  to  Impose  any  particular  system  upon  a 
contractor,  but  rather  define  the  characteristics  of  what  their  control 
and  reporting  should  include.  This  is  explained  in  the  additional  173-5 
excerpt: 

*3-5.  Analysis.  The  C/SCSC  do  not  require  the  submission  of 
data  or  reports  from  the  contractor  to  the  Government.  The 
criteria  only  set  forth  characteristics  which  contractors' 
systems  must  possess,  and  specify  the  type  of  data  which 
should  be  derived  from  the  systems."  (6) 

Also  the  schedule  management  requirements  are  further  illustrated  by  this 
continuing  excerpt  from  the  same  analysis  section. 

"c.  Data  Analyses.  Comparisons  of  Budgeted  Cost  for 
Work  Scheduled  (8CWS)  with  Budgeted  Cost  for  Work 
Performed  (BCWP)  relate  work  completed  to  work  scheduled 
during  a  given  period  of  time.  While  this  provides 
a  valuable  indication  of  schedule  status,  In  terms 
of  dollars  worth  of  work  accomplished,  it  may  not  clearly 
indicate  whether  or  not  scheduled  milestones  are  being 
met  since  some  work  may  have  been  performed  out  of 
sequence.  A  formal  time-phased  scheduling  system  must 
therefore  provide  the  means  of  determining  the  status  of 
specific  activities  and  milestones."  (6) 
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A  Checnilst  for  Program  Contro 


When  the  C/SCSC  procedure  is  applied,  tne  contractor  Is  evaluated  with 
the  following  questions  being  asked.  These  questions  are  also  excerpts 
from  173-5  and  Indicate  the  kind  of  detail  concern  ASD  program  management 
should  nave  for  schedule  control.  The  questions  are  from  a  checklist 
which  is  used  In  a  contractor  review. 

“1.  Schedule  the  authorized  wor«  :n  a  manner  which  describes 
t.ne  sequence  of  work  and  identifies  the  significant  task 
i nter-cepenaencies  required  to  meet  tn  •  development, 
production,  and  delivery  requirements  the  contract. 

a.  Dees  the  scheouling  system  contain:  prepare  exnioit 
showing  traceability  from  contract  task  level  to  work  package 
schedules. ) 


(I )  A  master  program  schedule? 

[2,  Intermediate  schedules  as  required  which  pro¬ 
vide  a  logical  sequence  from  the  master  scnedule  to  the  cost 
account  level? 

(3)  Detailed  schedules  which  support  cost 
account  and  work  package  start  and  completion  dates/events? 

b.  Are  significant  decision  points,  constraints,  and 
interfaces  identified  as  key  milestones? 

c.  Does  the  scneduling  system  provide  for  the  iden¬ 
tification  of  work  progress  against  technical  and  other 
milestones,  and  also  provide  for  forecasts  of  completion 
dates  of  scheduled  work? 

d.  Are  work  packages  formally  scheduled  in  terms  of  phy¬ 
sical  accomplishment  by  calendar  dates  (Gregorian,  Julian,  or 
manufacturing  day)? 

2.  Identify  physical  procucts,  milestones,  technical  perfor¬ 
mance  goals,  or  other  indicators  that  will  oe  used  to  measure 
output.. 


a.  Are  meaningful  indicators  identified  for  use  in 
measuring  the  status  cf  cost  and  schedule  performance? 
(Provide  representative  samples.) 

b.  Does  the  contractor's  system  identify  work 
accomplishment  against  the  schedule  plan?  (Provide  represen 
tative  examples.) 

c.  Are  current  work  performance  indicators  and  goals 
relatable  to  original  goals  as  modified  by  contractual 
changes,  replanning,  and  reprogratming  actions?  (Provide 
exhibit  showing  incorporation  of  changes  to  original  Indica¬ 
tors  and  goals.) 
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3.  Establish  and  maintain  a  time-phased  budget  baseline  at 
the  cost  account  level  against  which  contract  performance  can 
be  measured.  Initial  budgets  established  for  this  purpose 
will  be  based  on  the  negotiated  target  cost.  Any  other  amount 
used  for  performance  measurement  purposes  must  be  formally 
recognized  by  both  the  contractor  and  the  government.  (6) 

4.  To  the  extent  the  authorized  work  can  be  identified  in 
discrete,  short-span  work  packages,  establish  budgets  for  this 
work  in  terms  of  dollars,  hours,  or  other  measurable  units. 

Where  the  entire  cost  account  cannot  be  subdivided  into 
detailed  work  packages,  identify  the  far  term  effort  in  larger 
planning  packages  for  budget  and  scheduling  purposes: 

a.  Do  work  packages  reflect  the  actual  way  in  which  the 
work  will  be  done  and  are  they  meaningful  product  or 
management-oriented  subdivision  of  a  higher  level  element  of 
work?  (Provide  representative  sample.) 

b.  Are  detailed  work  packages  planned  as  far  in  advance 
as  practicable? 

c.  Is  work  progressively  subdivided  Into  detailed  wc-'' 
packages  as  requirements  are  defined? 

d.  Is  future  work  which  cannot  be  planned  In  detail  sub¬ 
divided  to  the  extent  practicable  for  budgeting  and  schedule 
purposes.  (Provide  sample. ) 

e.  Are  work  packages  reasonably  short  in  time  duration 
or  do  they  have  adequate  objective  indicators/milestones  to 
minimize  the  in-process  work  evaluation? 

f.  Do  work  packages  consist  of  discrete  tasks  which  are 
adequately  described?  (Provide  representative  sample.) 

g.  Can  the  contractor  substantiate  work  package  and 
planning  package  budgets? 

h.  Are  budgets  or  value  assigned  to  work  packages  and 
planning  packages  In  terms  of  dollars,  hours,  or  other 
measurable  units? 

1.  Are  work  packages  assigned  to  performing 
organizations?  (6) 

5.  Identify  on  a  monthly  basis  significant  differences 
between  planned  and  actual  schedule  accomplishment  together  with 
the  reasons. 

a.  Does  the  scheduling  system  identify  in  a  timely 
manner  the  status  of  work?  (Provide  representative  examples.) 

b.  Does  the  contractor  use  objective  results,  design 
reviews,  and  tests  to  track  schedule  performance?  (Provide 
examples.)"  (6) 

This  checklist  would  be  of  value  for  evaluating  every  project  cont 
system  as  applicable. 


III.  CURRENT  ASD  PLANNING  AND  SChEDUL ING  AREAS 


Tnere  are  three  areas  of  interest  whic-  are  currently  influencing  tne 
future  of  planning  and  scheduling  at  ASC.  They  are  the  (i)  Independent 
Schedule  Assessment  Program  (AFSC  Regulation  GOO-35,  dated  31  January  ’979, 
produced  icy  AFSC  Initiative  16-2,  (2)  the  AFSC  initiative  project  Vanguard, 
and  (3)  the  ASD  Automated  Management  Systems  program  now  Delng  developec  by 
the  ASO/ACP  organization. 


THE  :  NJEPENOEivT  SCHEDULE  ASS:  SSMEM 


The  Independent  Schecuie  Assessment  (IS-V.  program  regulation  resulting 
from  the  AFSC  Initiative  16  effort  is  pus  being  activated  at  ASO. 

A  copy  ct  the  regulation  is  included  as  Figure  III-1,.  A  draft  guide  for 
implement  at’ on  of  the  ISA  was  prepared  by  the  Initiative  16  team.  The 
draft  had  not  bean  approved  for  issue  as  this  report  was  prepared,  but 
excerpts  of  its  contents  will  be  used  because  it  not  only  explains  the 
thought  process  behind  the  ISA  authorship,  but  also  includes  the  results  of 
a  good  deal  of  research. 

The  purpose  of  and  an  introduction  to  the  ISA  according  to  one  of  these 
excerpts  are  as  follows: 

PURPOSE 

Independent  Schedule  Assessments  (ISAs)  are  intended  to 
orovide  an  assessment,  by  a  team  of  "experts"  from  outside 
the  program  office  of  the  realism  of  the  projected  program 
schedules.  ISAs  normally  are  conducted  at  major  AFSARC/DSARC 
milestones.  They  are  conducted  1r  conjunction  with  and 
integrated  into  Independent  Cost  Analysis  (ICAs).  In  special 
cases,  an  ISA  may  oe  conducted  without  being,  for  that 
occasion,  a  part  of  an  ICA.  Tho  results  of  an  ISA  shall  pro¬ 
vide  Air  Force  acquisition  management  with  visibility  and 
understanding  of  the  origin  and  basis  or  the  schedule 
estimate,  significant  factors  influencing  or  constraining  the 
projected  schedule,  and  tne  risks  involved  in  successful 
achievement  of  the  projected  schedule.  The  report  of  the  ISA 
team  should  include  recommended  actions  which  would  reduce 
schedule  risks  and  enhance  the  probability  of  successful 
schedule  achievement. 

INTRODUCTION 

An  ISA  Is  essentially  a  three-step  process,  data 
collection,  analysis/evaluation,  and  documentation.  Data  can 
be  collected  from  three  general  sources:  the  program  office, 
the  contractor  and  historical  records  on  similar  programs. 

Pricr  to  collecting  data  at  the  contractor's  facility,  the 
team  should  develop  guide'lines  for  data  collection  and  notify 
contractor  of  the  specific  information  desired.  Data  collec¬ 
tion  should  emphasize  how  the  schedule  estimate  was  developed, 
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DEPARTMENT  j:  THE  AIR  FORCE  AFSC  REGULATION  SOO-35 

Headquarters  An  Force  System.,  Command  31  January  1973 

Andrew*  Am  Force  Base,  DC  20j34 

Acquisition  Management 

INDEPENDENT  SCHEDULE  ASSESSMENT  PROGRAM 

Thi*  regulation  prescribes  poi..ies,  assigns  responsibilities,  and  establishes  procedures  for  conducting  and 
documen'jig  Independent  Schedule  Assessments  (ISA)  foi  acquisition  programs. 


1  Policy: 

a  .An  ISA  is  an  independent  assessment  of  the 
reasonableness  of  the  system  p  ogram  office  (SPO ) 
master  integrated  ptogr-rr.  schedule. 

b.  An  ISA  will  be  lonuucted  for  acquisition 
programs  before  each  AFSARO  DSARC  milestone 
and  as  otherwise  directed  ny  HO  AFSC. 

c.  The  ISA  team  chief  and  team  membership 
will  be  comprised  of  personnel  externa!  tc  the  re¬ 
sponsible  SPO. 

d.  The  ISA  is  considered  to  be  part  of  the 
Independent  Cos:  Analysis  (.ICA)  (AFR  171-5 1). 
include  ISA  documentation  as  an  annex  to  the  1CA 
documentation. 

2.  Responsibilities 

a.  HQ  AFSC: 

(1)  HQ  AFSC/ AC  will  provide  overall  man¬ 
agement  of  the  ISA  program 

(2j  Other  DCSs  will  support  HQ  AFSC, 'AC 
.n  conducting  and  rcportn.g  on  ISA 

b  AFSC  Pioduct  Divisjoni: 

(!  >  Ensure  ISAs  are  conducted  as  directed  by 
HQ  AFSC. 

(2)  Unless  otherwise  directed  by  HQ  AFSC, 
the  Comptroller  will  appoint  the  i.SA  team  chief. 

(3)  Ensure  that  the  TO  provides  the  ISA 
team  the  master  integrated  program  schedule,  con¬ 
sistent  with  the  program  which  will  be  presented  for 
AFSARC/D3ARC  deo.sicn.  and  necessary  technical 
supposing  data. 

c.  ISA  Team  Chiefs: 

(1)  Select  team  membership  appropriate  to 
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the  scope  and  nature  of  the  specific  ISA  to  be 

conducted. 

(2;  Prepare  an  ISA  pian  for  incorporation 

:r,o  the  ICA  pian. 

(3)  Conduct  the  ISA.  Furnish  me  ICA  team 
witn  the  findings  and  results. 

(4)  Define  and  discuss  ISA  results  with  the 
program  manager  mid  product  division  commander 
as  par*  of  the  ICA  briefing  cycle. 

3.  Assessment  Composition: 

a.  An  ISA  will  address  that  portion  of  the  ac¬ 
quisition  program  covered  at  the  AFSARC/DSARC 
major  miles. one,  evaluating  general  schedule  risk 
and  identifying  the  critical  path.  In  addition,  the 
assessment  will  identify  the  specific  pacing  or 
critical  schedule  events  and  show  program  schedule 
variations  to  include  iow-,  medium-,  and  lugh-nsk 
schedules.  As  part  of  the  above  low-,  medium-,  and 
high-nsk  schedule  identification  and  assessment,  the 
ISA  will  evaluate  alternate  production  rates,  if  appli¬ 
cable  to  the  particular  AFSARC/DSARC  milestone. 

b.  The  ISA  will  assess  substantiating  data  on  the 
projected  master  integrated  program  schedule.  This 
would  include  identifying  and  understanding  the 
origin  and  derivation  of  the  schedule  estimate, 
methodology  used  to  develop  the  schedule  estimate, 
constraints  influencing  the  estimate,  and  relevant 
history  or  experience  that  would  provide  indicators 
for  future  schedule  expectations. 

c.  Documentation  will  consist  of  detailed  brief¬ 
ing  charts  and  an  accompanying  script  which 
presents  ISA  results  as  shown  in  attachment  1. 

ALTON  D.  SLAY,  General,  US.AF 
Commander 


JAMES  L.  WYATT,  JR.,  Lt  Col,  USAF  1  Attachment 

Director  of  Administration  Independent  Schedule  Assessment 
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AFSCR  800-35  Attachment  ) 


31  January  19'9 


INDEPENDENT  SCHEDULE  ASSESSMENT 
DOCUMENTATION  FORMAT 

1.  Purpose  of  Aaeament 

a.  Purpose 

b.  Objectives  to  be  obtained 

2.  Systems  Description 

a.  Physical,  technical,  and  performance  characteristics 

b.  Parameters  required  for  assessment  effort 
c  System  concepts,  plans,  etc. 

3.  Background  and  Scope 

a.  ISA  direction 

b.  Milestones  covered 

c.  Current  program  acquisition  strstegy 

4.  Assumptions  and  Limitations 
t.  Ground  rules 

b.  Study  limitations 

c.  Other  constraints 

5.  S  eh  adult  Asmeamcnt  Procedures 
s.  Data  sources 

b.  Models  used 

c.  Depth  of  assessment 

d.  Risk  and  uncertainty 

e.  Other 

6.  Summary  result! 

a.  ISA  resulta 

b.  Comparisons  with  direction,  PO  schedules,  previous  ISAs,  etc. 

7.  Conclusions 

a.  Reasonableness  of  existing  schedules 

b.  Suggestions 

Attachments: 

A  Detailed  Assessment 

B.  Riik  and  Sensitivity 

C.  References 

D.  ISA  Review  Checklist 
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wnat  is  tne  extent  of  substantiating  uata  *or  time  span  esti¬ 
mates  at  Both  master  and  subtier  functional  schedule 
estimates,  what  a’-e  the  uncertainties  in  tne  estimates  and 
what  contingencies  were  Included  to  accommodate  them,  and  what 
are  the  dependent  and  Independent  elements  in  the  schedule 
estimate.  Upon  completion  of  the  data  collection,  the  final 
determination  of  the  analytical  approach  to  be  taken  must  be 
made.  If  the  approach  is  predetermined,  it  is  assumed  that 
all  the  necessary  data  exists.  Therefore,  unless  advanced 
planning  prescribes  an  approach  and  input  data,  the  analytical 
approach  will  be  dependent  upon  the  quality  and  quantity  of 
available  oata.  It  is  highly  desirable  to  require 
contractors,  either  by  proposal  instructions  or  by  contract 
statement  of  work  to  provide  schedule  networks,  production 
plans,  and  substantiating  data  in  contemplation  or  ISAs  at 
AFSARC/DSARC  milestones.  Typically,  several  approacnes  can  be 
used  to  analyze  schedules.  These  include:  probablistic  analysis 
of  time  estimated  networked  events,  critical  path  network, 
estimates  based  cn  establisned  time  estimating  relationships 
(parametric  analysis)  and  oetailed  grass  roots  or  built  up 
subtler  schedules  car.  De  used  alone  or  in  combination. 

Documentation  of  tne  assessment  will  consist  of  a  summary 
report,  briefing  cnarts  and  accompanying  script  which  present 
the  results  of  the  ISA.  The  briefing  should  highlight  the 
projected  schedule  in  terms  of  key  milestones  such  as 
authority  to  proceed,  PDR,  CDR,  first  flight,  and  major  func¬ 
tional  activities  sucn  as  design,  tooling  fabrication,  assem- 
oly  and  test.  Identified  jcredule  constraints  and  risk 
assessment  shall  be  presented  for  each  functional  activity. 

Applicable  experience  to  date  should  be  used  as  supporting 
data  for  schedule  projection.  The  analytical  method  used 
shall  be  described  in  detail.  The  assessment  should  result  in 
a  quantitative  or  qualitative  probability  of  schedule 
achievement.  (10) 

As  tne  ISA  is  initiated  at  ASD,  it  should  provide  some  meaningful  new 
assistance  in  understanding  the  current  status  of  ASD  programs.  It  should 
also  provide  a  oasis  for  a  realistic  analysis  of  its  future  performance 
and  its  potential  fo1-  completion  of  schedule.  It  would  be  assisted  by  an 
AoD  management  data  collection  anc  sorting  system  and  should  provide  good 
statusir.g  assistance  to  project  Vanguard. 

0tne--  Initiative  16  Team  reports  are  summarized  in  Appendix  3  and  4  and 
is  an  excellent  source  for  general  P&S  function  review. 

PROJECT  VANGUARD 

Project  Vanguard  was  also  an  AFSC  planning  initiative.  The  following  are 
excerpts  from  the  contents  of  a  letter  Issued  by  ASD/XR  in  May  1979 
to  provide  for  data  collection  for  the  project.  (2) 

1.  The  purpose  of  Vanguard  is  to  provide  Integrated  program 
planning  for  exploratory,  advanced,  and  engineering 
development.  Plans  will  be  developed  to  describe  activities 
for  each  mission  area  and  will  provide  three  perspectives: 
mission  area,  major  force  element,  and  functional.  Plans 
will.  In  general.  Include  a  base  line  and  proposal  for  changes 


to  the  base  line  based  on  analyses  and  assessments.  The  plan 
will  be  briefed  to  the  AFSC  Panels,  Program  Evaluation  Group 
(PEG),  and  Council  during  the  Program  Objective  Memorandum 
(POM)  development  cycle.  The  AFSC  plan,  when  approved  by  the 
Commander,  will  be  the  final  output  and  will  be  submitted  to 
the  Air  Staff  at  the  AFSC  POM  input. 

2.  Within  the  direction  guidelines  of  AFSC/XR,  ASO  will  be 
responsible  for  the  development  of  analyses  and  plans  asso¬ 
ciated  with  many  of  the  mission,  major  force  element,  and 
functional  areas  of  Vanguard. 

3.  A  first  major  effort  In  the  Vanguard  process  Is  data 
collection.  A  portion  of  the  required  data  is  available  in 
established  planning  documents,  such  as  the  Five  Year  Defense 
Plan  (FYDP).  However,  it  is  necessary  to  enlist  Product  and 
Laboratory  organizations  for  their  assistance  in  data  collec¬ 
tion  because  of  the  need  for  Identifying  and  categorizing 
program  elements  to  the  project  level  and  because  of  the  unique 
perspective  that  these  organizations  can  lend  to  the  prcce?:. 

4.  The  following  Information  is  required  for  each  Program 
Element/Project: 

a.  Name  of  Program  and  Program  Element/Project  Number. 

b.  Vanguard  Planning  Areas  (Appendix  2)  (Identify  the  Mission/ 
Submissions,  Major  Force  Elements,  and  Functional  Areas  for 

which  this  program  has  application).  If  more  than  one  area  is 
applicable,  list  them  from  most  to  least  important. 

c.  Replacement  (Identify  what  system  or  subsystem  this 
replaces  and  how;  i.e..  Class  V  Modification.  In  the  sub¬ 
system  area  also  identify  the  major  systems  it  is  to  be  put  on 
or  in,  and  whether  there  is  a  specific  effort  established  to 
accomplish  this  Integration.) 

d.  Major  Area  of  Improvement  (Identify  only  those  areas 
where  significant  improvement  is  expected  and  estimate  the 
Improvement  which  could  be  realized.  If  more  than  one  is 
given,  list  them  from  most  to  least  Important). 

e.  Funding  by  Fiscal  Year  (the  funding  should  be  given 
either  to  the  end  of  the  program  or  to  1995,  whichever  comes 
first.  These  funds  should  be  divided  into  R&D  and  Production 
funds  for  Program  Element/Project,  "he  Initial  five  years 
should  correspond  to  the  January  1979  FYDP  submission). 

f.  Date  of  Milestones  and  Planned  IOC  (for  technology  and 
subsystem  programs  not  requiring  SDARCs  give  the  equivalent) 
as  follows: 


Milestone 


Equivalent 


0 

1 

2 

3 

IOC 


g.  Quantity  to  be  proauceo  If  known. 

n.  Purpose  (oriefly  state  the  purpose  cf  the  system,  subsystem  or 
technology  program) 

i.  Description  (a  brief  description  of  the  system,  subsystem,  or 
technology  program) 

j.  Related  Programs  or  Support  Technology  (identify  other  programs 
which  are  related  to  this  program  or  which  are  required  for  this  program, 
to  be  successful j  l.e.,  P£/t<.sk  number,  point  of  contact,  office  symbol, 
OPR,  etc.).  Indicate  whether  integration  with  these  Programs  are 
sufficiently  planned  for  and  funded. 

k.  Remarks  (provide  any  other  information  which  may  be  of  assistance 
in  this  project). 

Vanguard  planning  areas  are  provided  as  Appendix  5  to  this  report. 
AUTOMATED  MANAGEMENT  DATA  SYSTEM 


Concept  Formulation  Study  Sheet 
Validation/Demonstration  Start 
Full-Scale  Engineering  Development  Start 
Production  Decisions 
Initial  Operational  Capability 
Production  Start  and  Stop 


The  need  for  an  automated  management  data  collection  and  sorting  method  to 
maintain  the  quantity  of  program  detail  status  information  required  in 
a  usable  manner  and  on  a  timely  basis  has  long  been  evident  at  ASD.  ASD/AE 
developed  sucn  a  system  for  its  programs.  The  symbol  on  the  cover  of  its 
Management  Information  System  Guide  well  illustrates  the  goal  of  Program  Control 
organizations  in  general  and  planning  and  scheduling  as  a  participating 
function.  (See  Figure  1 1 1-2) 

In  tnis  guide  AE  describes  the  background  for  the  system  as  follows. 

"The  ASO/AE  Management  Information  System  (AEMIS)  is  an  Integrated 
management  reporting  system  inducing  a  mechanized  management  data 
storage  and  retrieval  system  capable  of  providing  recurring  and  spe¬ 
cial  reports,  in  both  hard  copy  and  projected  video  form. 

The  need  for  a  computer-based  system  to  provide  corporate  management 
information  was  recognized  in  early  1976  when  the  complex  nature  of 
the  ASO/AE  workload  was  investigated.  This  workload  is  large, 
diverse  and  highly  dynamic.  Suranarization  of  corporate  management 
data  for  this  workload  cannot  be  accomplished  effectively  by  manual 
means.  Development  of  the  AEMIS  Integrated  Matrix  Management 
Evaluation  and  Reporting  System  (IMMERSE)  proceeded  In  areas 
appropriate  for  providing  a  valid  corporate  memory  and  reporting 
capability. 

The  basic  development  concept  employed  was  to  design  a  computerized 
data  bank  containing  input  data  from  the  various  management  functions 
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FIGURE  1 1 1-2 

AUTOMATED  "MANAGEMENT  INFORMATION  SYSTEM  GUIDE"  ILLUSTRATION 


supporting  the  AE  program  management  efforts.  The  integration  scheme 
is  depictea  in  Figure  111-3.  The  front  face  of  the  cube  shows  the 
types  o*  input  data  envisioned  for  integration  into  the  AE  Management 
Information  System.  Tne  top  face  of  the  cube  represents  the  source 
of  the  input  data  and  the  side  face  depicts  the  various  management 
levels  capable  of  interrogating  the  system  across  the  entire  range  of 
input  data.  Tnls  approach  to  system  design  enhances  centralized 
control  of  a  uecentral ized  management  effort  normally  associated  with 
a  multiprogram  management  organization.  It  also  facilitates  manage¬ 
ment  information  data  retrieval  from  an  almost  infinite  comDlnation 
of  data  elements  stored  c r.  each  program."  (11) 

The  following  eighteen  milestones  were  st.ucteu  for  their  schedule 

tracking  control. 


Definitions  of  <ey  Milestones  (11) 

°RCGRAM  AUTHORITY  RECEIVED 

NEW  START  PROGRAM 

PROGRAM  rT-<ATEGv  -'STAB- ISric'D 

WO kr  ARtAADOw.N  Sii\UCTjR£  PREPhRED 

STATEMENT  OF  WORn  PREPARES 

RFP  (Request  »'or  P-oposal)  RELEASED 

START  SOURCE  SELECTION 

CONTRACT  AWAAl 

PDR  (Pre'iminary  Design  Review)  COMPLETED 
CDR  (Grit lea  Design  Review)  COMPLETED 
FIRST  HARDWARE  DELIVERED 
First  prototype  nardware  (or  software) 

For  a  pr- -production  contract  this  is  tne  first  pre-production  model. 
For  a  production  contract  this  is  the  first  production  model. 

TEST  PROGRAM  COMPLETED 

PROGRAM  DECISION  MADE 

PCA  (Physical  Configuration  Audit)  rlEcD 

MAX  PRODUCTION  RATE  ACHIEVED 

IOC  (Initial  Operational  Capability) 

PMRT  (Program  Management  Responsibility  Transfer) 

physical  completion  date 

Additional  information  on  the  ASD/AE  system  is  included  in  Appendix  1. 
ASP-WIDE  AUTOMATED  MANAGEMENT  INFORMATION  SYSTEM 


AFSC  requested  that  this  kind  of  system  be  developed  on  a  broader  scale 
and  ASD/ACP  began  preparation  for  its  ASO  Automated  Management  Systems  program. 
Tnis  program  includes  access  to  the  many  different  types  of  ASD  computer  aided 
programs  as  a  by-product  of  its  need  to  collect  data  and  sort  it  for  program 
management. 

1.  Studies  -  surveys,  analyses,  evaluations 

2.  Plans  -  program,  procurement,  implementation 

3.  Administrative  Documentation  -  Projected  automation 
requirements  (PAR),  data  automation  requirements  (OAR), 
contract  components,  data  base  administration 


INPUTS 


FIGURE  II 1-3 


MANAGEMENT  INFORMATION  SYSTEM 
DATA  INTEGRATION 


Btt-jr  T 


4.  Program  Control  fcuugets,  schedule  and  financial 
management,  program  documentation  repository,  access  controls 

5.  Data  Base  administration  -  definition,  access 
control,  initialization 

6.  Procurement  -  buyer,  contracting,  source  selection 
support 

An  interview  with  Col  James  Thompson  of  Program  Control  Directorate  (ACP)  in 
December  1979  Indicatec  that  ASD  was  adaoting  the  "SMART”  management  infor¬ 
mation  system  technique  used  at  Eg! in  AFB,  Florida.  At  that  time  the  new 
system  had  60  current  participants  ana  £3  potential  participants.  Like  any 
new  system,  constant  encouraging  was  needed  to  obtain  the  date  in  a  timely 
and  complete  manner  but  progress  was  steady.  Automated  viewgraphs,  with  the 
associated  data,  is  one  of  the  goals  of  the  system  and  eventual  use  of  desk 
mounted  CRT's  is  hoped  for  in  the  future. 

Excerpts  from  tne  Users  Dictionary  describe  the  essential  aspects  of 
SMART.  These  experts  are  provided  in  appendix  6. 
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IV.  PLANNING  AND  SCHEDULING  ORGANIZATION 


Planning  and  scheduling  as  defined  in  section  I  is  being  primarily 
done  by  the  Deputy  for  Development  Planning  (ASD/XR),  the  various  SPO 
Program  Control  organizations,  and  the  Contract  Management  Division  (CMD). 
They  are  supported  in  this  function  by  the  Controller  (ASD/AC) 
organizations,  the  Program  Costs  Directorate  and  the  Cost  Analysis 
Directorate  and  by  the  Deputy  for  Procurement  and  Manufacturing. 

DEPUTY  FOR  DEVELOPMENT  PLANNING  ( XR ) 

The  Deputy  for  Development  Planning  (XR)  is  pulling  the  overall  ASD 
mission  plan  together.  XR  supports  AFSC  Regulation  80-2,  AFSC  Plans  and 
Programs,  at  ASD.  Excerpts  from  this  regulation  describe  the  planning 
and  scheduling  type  of  functions  included  in  this  assignment.  (13) 

This  regulation  establishes  policy  and  assigns  specific  func¬ 
tions  and  responsibilities  in  AFSC  for  development  planning 
activities  and  the  AFSC  Program  Plan. 

1.  Policy: 

a.  To  Implement  the  AFSC  mission  of  advancing  technology 
and  acquiring  systems  and  equipment  needed  by  the  United 
States  Air  Force  requires  planning  which  is  divided  into  three 
categories. 

(1)  Development  planning  is  the  process  of 
recognizing  and  synthesizing  the  future  needs  of  the  Air  Force 
and  reconciling  those  needs  with  available  technology. 

(2)  Technology  planning  is  tne  process  of  establishing 
the  broad  framework  for  the  technology  base  programs.  This 
planning  includes  establishing  near  and  long  term  technology 
planning  objectives  that  are  responsive  to  Air  Force  capability 
needs. 


(3)  Engineering  development  and  production  planning 
is  the  process  of  mapping  out  programs  through  full-scale 
development  and  production.  It  develops  the  time-phased  costs 
and  schedules  for  achieving  the  delivery  of  operational 
systems,  subsystems,  and  equipment  to  the  major  commands  (AFR 
800-2). 

b.  The  AFSC  Program  Plan  is  the  integration  of 
development,  technology,  and  engineering  development  and  pro¬ 
duction  planning  activities  into  a  logical  ordering  and  flow 
of  programs  from  the  inception  of  ideas  and  technical  options 
to  production  systems  and  equipment  in  the  Air  Force 
inventory. 

(1)  The  AFSC  Program  Plan  Is  developed  from  USAF  and 
OSD  guidance,  with  the  President's  budget  as  a  baseline,  and 
forms  the  basis  of  the  formal  submission  of  the  command  in  the 
Program  Objectives  Memorandum  (POM)  process. 
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U)  Tn-  nr  SC  Program  Plan  requires  the  development  or 
j  number  of  member  plar.i  to  provide  perspectives  necessary  for 
presentation  ar,ci  evaluation  of  tne  aggregate  of  programs. 
Mission  area  plans  ore  prepares  f or  each  Air  Force  mission 
area  sucn  as  strategic  offense,  strategic  defense,  tactical 
air-to-ground,  ana  otners.  Major  force  element  plans  (such  as 
for  fignte*'  force,  missile  force,  and  oomber  force )  address 
systems,  supporting  subsystems  and  armament  that  have  enough 
homogeneity  to  accomplish  a  number  of  mission  area  tasks. 
Functions’  plans  have  functional  or  technical  homogeneity  and 
adaress  sc csy stems  o-  systems,  technologies,  and  concepts  that 
are  common  to  two  or  more  force  elements,  mission  area  tasks, 
or  mission  areas. 


THE  SPO,  PROGRAM  CONTROL  ORuANIZATTGN 

The  next  two  primary  planning  ana  scheduling  functions  are  the  SPO 
program  control  organizations  and  CMD.  The  SPO  Director  of  Program 
Control  has  tne  bulk  of  active  program  planning  and  scheduling  along  with 
the  contractor  coordination  anc  data  support  function  of  CMD.  The  func¬ 
tions  of  cMO  are  described  1 n  some  detail  furtner  on.  The  responsibility  of  tne 
SPO  Director  of  Program  Control  is  excerpted  from,  Functional  Mission  Statement 
(CPC  31,  cateu  Marcn  7S)  issued  by  the  Comptroller  (AC). 

PROGRAM  CONTROL  FUNCTIONAL  MISSION  STATEMENT 


PURPOSE:  The  purpose  of  this  policy  letter  is  to  provide  an 
overalT  definition  of  the  functions  ana  responsibilities  of 
SPO  Program  Control  organizations.  The  functions  and  respon¬ 
sibilities  listed  in  this  policy  letter  represent  a  minimum 
level  of  performance  that  must  be  met  by  all  Program  Control 
organizations.  Those  organizations  desiring  to  expand  the 
scope  of  tiieir  responsibilities  beyond  tnose  listed  herein 
will  do  so  through  the  publication  of  a  SPO  Operating 
Instruction  (Cl)  covering  those  differences.  All  such  or s 
will  be  coordinated  through  ASD/AC. 

Tne  Director  of  Program  Control  for  each  organization  at 
ASO  is  responsible  to  the  System  Program  Director  and  his 
staff  for  all  financial  and  resource  management  functions  on 
assignee  programs.  These  functions  ’Delude: 

Planning  -  This  process  consists  of  describing  and 
assigning  tasks  so  that  all  participants  will  mutually 
understand  who  is  responsible  for  each  acquisition  action. 
Tasks  include: 

1.  Integrating  all  plans  into  a  Program 
Management  Plan.  Requires  writing,  editing,  compiling, 
coordinating,  distributing  and  updating  of  the  plan  with  the 
assistance  of  other  SPO  and  ASO  staff  activities. 

2.  Preparing  and  issuing  Joint  Agreements,  Memos 
of  Understanding,  and  other  formal  arrangements  with  other 
participants  in  the  acquisition  process. 


3.  Reviewing  and  analyzing  the  PMD  and  the  AFSC 
Form  56  to  identify  the  action  needed  to  carry  out  the 
direction. 

4.  Maintaining  the  official  documentation  file 

for  the  SPO. 

Scheduling  -  Develops  and  maintains  a  Master  Schedule 
which  Incorporates  all  of  the  sub-schedules  that  are  needed  to 
fulfill  the  requirements  of  the  Program  Management  Plan. 

These  sub-schedules  include,  but  are  not  limited  to  the 
fol lowing: 

1.  Manpower  loading  as  related  to  various 

milestones. 

2.  WBS  -  Relate  interfaces  to  key  milestones. 

3.  Update  schedules  -  report  deviations  from  plan 
with  impact  and  recommended  solutions. 

Forecasting  -  Looking  downstream  to  see  where  a 
program  fs  going  and  proposing  alternatives  to  accommodate 
threat  or  hasten  progress.  The  tasks  include: 

1.  Develop  and  continually  update  the  data  base 
needed  to  make  accurate  projections. 

2.  Determine  the  validity  of  the  data. 

3.  Know  the  assumptions  upon  which  a  forecast  is 

based. 

4.  Test  the  forecast  by  determining  the  probability 
of  the  occurrence  of  events  happening  as  scheduled. 

5.  Identify  potential  problems  and  develop  alter¬ 
native  plans  to  accommodate  these  problems  should  they  occur. 

6.  Project  Program  progress.  (14) 

THE  COMPTROLLERS  TWO  SUPPORT  FUNCTIONS 

In  the  support  area  the  comptroller  has  two  organizations,  ACP  and  ACC. 
ACC's  activity  in  the  Independent  Schedule  Assessment  (ISA)  is  described 
In  Section  III.  ACP  Is  responsible  for  the  automated  management  infor¬ 
mation  system  and  assists  the  SPC  Directors  of  Program  Control  in  their 
mission  in  certain  areas.  An  excerpt  from  Position  Description  ACP-09530 
updated  copy  Indicate  some  of  the  functions  of  ACP. 

DUTIES  AND  RESPONSIBILITIES  OF  PROGRAM  CONTROL  DIRECTORATE 

Type  of  Work  Supervised 

1.  Formulation  of  top  level  policy  and  procedures  for  the  management 
of  the  Comptroller  matrix  organization.  This  organization  consists  of  over 


350  personnel  co'iocateo  1  r  a', ASO  prugro, n  offices.  It  covers  the  functional 

areas  of  financial  .management,  cost  analysis,  program  analysis,  aro  all  clerical  areas. 


2.  Balancing  tne  assigned  tnatri*  workforce  against  the  requirements  of 
the  various  ASD  system  program  offices  in  order  to  Insure  an  equitable  Dalance 
of  personnel,  In  numbers,  functional  skills,  and  levels  of  experience  in  each 
organization  consistent  with  the  relative  priority  of  each  program  and  witn 

its  position  in  tne  acquisition  life  cycle. 

3.  Design.,  development,  test,  and  implementation  of 
automated  management  systems  for  use  1  n  all  aspects  of 
acquisition  program  management  at  all  levels  in  ASD  up  through 
Cotnnander,  ASD  level.  Integration  cf  ccally  developed  systems 
with  systems  directed  by  higher  headquarters.  Chair  ASD 
Automated  Management  Working  Grou^,  ana  serve  as  secretariat 
for  ASD  Automated  Management  Steering  Group  wnich  Is  chaired 

by  the  Comptroller,  ASD.  Integration  of  diverse  requirements 
of  separate  ASD  SPO's  and  staff  agencies  into  a  unified  ASD 
automation  program  for  approval  by  the  Comnander,  ASD. 

4.  Management  of  the  ASD  Manhour  Accounting  System  (MAS)  throughout 
ASD  anc  all  analysis  of  MAS  information.  Production  of  special  studies  and  anal¬ 
yses  of  MAS  data  for  ASD  managers  at  all  levels  including  Commander,  ASD. 

5.  Conduct  workload  surveys  of  ASD  organizations  to  determine  detailed 
personnel  requirements  in  program  control  functional  areas.  (15) 

THE  OEPpTV  FOP.  PROCUREMENT  AND  MANUFACTURING  (PP) 

The  re'  a  of  the  Deputy  for  Procurement  and  Manufacturing  (PP)  is  well 
established  in  ASC.  It  includes  prucurement  specialists  who  are 
knowledgeable  to  procurement  lead  times  and  contractor/vendor  delivery 
capability.  It  a’so  includes  manufacturing  specialists  who  are  fully 
qualified  to  assess  production  lead  times  and  production  plan 
feasibilities  "nese  personnel  are  essential  to  SPO  planning  and  sched¬ 
uling  capabi ' . ty. 

CONTRACT  MANAGEMENT  DIVISION 

Although  the  Contract  Management  Division  is  a  separate  division  from  ASD  it 
is  an  integral  part  of  the  planning  and  scheduling  function  for  ASD  programs. 

The  following  excerpts  from  a  CMD  briefing  explain  their  function.  (3) 

AFCMD  Headquarters  Functions 

1.  Ensure  effective  implementation  of  contract  management 
policies  and  procedures  throughout  the  coitmand. 

2.  Promote  and  facilitate  necessary  coordination  between  the 
••Tious  plant  representative  and  test  site  offices. 

3.  Ensure  effective  response  by  field  units  to  requirements 
laid  on  by  system  program  offices  and  higher  headquarters. 

4.  Evaluate  Air  Force  and  DOD  procurement  policies  and  proce¬ 
dures  in  the  light  of  field  experience  and  recommend 
changes  needed  to  improve  in-plant  aspects  of  weapon 
system  procurement. 


5.  The  Headquarters  directorates  and  staff  offices  also 
accomplish  a  number  of  operational  functions.  These 
Include  production  readiness  reviews,  "should  cost" 
studies,  surveys  of  contractor  management  systems  ana  pro¬ 
curement  methods,  price  analyses  of  contractor  proposals, 
default  terminations,  flight  operations  stanoardizatior 
and  evaluation,  reviews  on  contractor's  inventions  and 
patent  activities,  reviews  and  analyses  of  contractor 
insurance  programs,  and  management  of  communications 
security. 

6.  New  ideas  and  projects  for  improving  contract  management,  which  have 
been  assigned  major  command  emphasis. 

The  CMO  Mission  is  to  "help  the  System  Program  Director  bring  his  program 
in  on  target  and  to  see  that  the  contractors  under  AFCMD  cognizance  live  up 
to  their  contractual  promises."  The  arms  of  AFCMD  which  are  in  direct  con¬ 
tact  with  the  contractor  are  the  AFPRO's  (Air  Force  Plant  Rep’-esentati ve 
Office).  The  AFPRO/SPO  relationship  and  his  functions  are  described  as 
follows: 

AFPRO/SPO  Relationship 

The  AFPRO  SPO  relationship  is  one  wherein  the  AFPRO  is  a 
member  of  a  team  whose  efforts,  in  support  of  the  SPO  are 
planned,  organized,  and  coordinated  between  the  Air  Force 
Plant  Representative  and  the  System  Program  Director  to 
expeditiously,  effectively,  and  economically  complete  the 
SPO's  acquisition  program. 

As  with  all  other  organizations  participating  in  the  acquisi¬ 
tion  program,  the  AFPRO/SPO  relationship  is  a  "two  way 
street"  and  reciprocity  is  essential: 

a.  The  SPD  must  insure  the  participating  AFPR  is 
constantly  aware  of  his  program  from  all  viewpoints  which 
affect  the  contract  and  any  changes  in  the  supoort  to  be  Dro- 
vided  by  the  AFPRO. 

b.  The  appropriate  AFPR  must  insure  that  the  SPD  is 
constantly  informed  of  the  contractor's  performance  to  the 
terms  of  the  contract  and  of  any  problems  that  may  impact  the 
suppo^'  to  be  provided  by  the  AFPRO. 

During  the  process  of  establishing  the  requirements  to  be 
negotiated  with  the  AFPR  for  his  particular  program,  the  SPD 
must  consider  that  each  AFPRO  has  several  contracts 
(sometimes  as  many  as  several  hundred)  assigned  from  AFSC, 

AFLC,  Army,  Navy  and  NASA.  Many  programs  have  a  "tailored" 
set  of  instructions  to  be  performed  by  the  AFPRO;  e.g.,  not 
all  assigned  contracts  require  performance  of  all  AFCMD  func¬ 
tions  nor  are  the  function'  common  to  all  contracts  performed 
in  the  same  manner.  Further,  the  SPO  and  AFPRO  are  each 
responsible  for  various  aspects  of  the  contract.  Therefore, 
the  SPO  and  associated  AFPR  must  get  together  to  determine 
those  functions  that  can  oe  most  effectively  and  efficiently 
performed  in-plant  by  the  AFPRO  and  to  "carve  out"  those  that 
can  best  be  performed  within  the  SPO. 
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The  procedures  to  oe  r  j'l  '.oweo  a.sc  specific  tasks  required  of 
the  A FPRO,  incl-ding  associate.:,  delegations,  limitations, 
scheduis,  ar.c  processes  necessary  to  estaolish  and  mairta’n 
clear  lines  of  common i cat  ions  Detween  the  SPG  and  AFPRG,  are 
formally  documented  and  agreed  to  In  a  Memorandum  of 
Agreement  (MOA). 

MEMORANDUM  OF  AGREEMENT  (MOA) 

Normal  cort-act  administration  service  Support  functions  are 
listed  in  Armed  Services  Procurement  Regulation  { A£°R',  1-405. 

The  MOA  is  used  oy  mFCMD  to  clarify  st a  pur:  requirements, 
delete  unnecessary  functions,  or  specify  additional 
functions,  over  and  aoove  those  listed  in  the  ASPR,  to  oe 
performed  Dy  An  APPRO  for  a  S?0  O'-  other  buying  activity. 

Tne  agreement  stipulates  the  functions  to  he  performed, 
including  delegations  of  authority  to  perform  those  functions 
and  the  procedures  for  incorporation  required  changes  in 
applicable  contracts. 

A  clear,  understandable  MOA  facilitates  provision  of 
contract  management  support  to  the  program  offices  by 
reducing  the  total  decision-making  time,  assuring  compliance 
with  contractual  requirements  (cost,  schedule,  performance), 
and  closely  integrating  tne  DOD-inaustry  team's  effort  to 
cope  with  program  variations. 

TYPICAL  AFPRO  FUNCTIONS 

ENGINEERING 

1.  Provide  in-plant  engineering  support  to  systems  program 
offices  and  other  buying  activities. 

2.  Assure  the  contractor  has  acceptable  engineering  manage¬ 
ment  systems  and  that  he  follows  those  systems. 

3.  Help  assure  complete  contractor  understanding  of  contractor 
specif  icatior,  requirements . 

4.  Evaluate  the  engineering  aspects  of  contractor's 
proposals. 

MANUFACTURING  OPERATIONS 

1.  Evaluate  the  contractor's  production  planning  and  manu¬ 
facturing  capability. 

2.  Evaluate  ano  act  on  contractor  need  for  manufacturing 
resources . 

3.  Check  the  contractor's  manufacturing  operations  day-to-day. 

4.  Track  and  report  on  status  of  contractor  deliveries. 

5.  Evaluate  the  contractor's  traffic  management  system. 

6.  Evaluate  the  contractor's  packaging  management  system. 

ESTIMATING  FUNCTIONAL  SIMILARITIES 

The  elements  of  estimating  have  many  things  in  common  with  planning,  scheduling, 
and  cost.  The  same  data  collected  by  estimators  Is  required  to  identify  engi¬ 
neering  and  production  functions,  and  material  and  other  resources  required  to 
develop  the  schedule.  Master's  Thesis  by  Major  (USAF)  Edwin  M.  Lewis  and  Eugene 
D.  Pearson  on  "The  Air  Force  Cost  Estimating  Process:  The  Agencies  Involved  and 
Estimating  Techniques  Used"  has  been  added  as  Appendix  2. 


V.  QUESTIONS  FOR  PLANNING  &  SCHEDULING  ENHANCEMENT 


The  planning  and  scheduling  related  organizations  can  always  improve 
their  effectiveness  by  asking  itself  certain  questions  basic  to  that 
discipline.  Some  of  these  questions  fo’low.  They  are  proposec  for  self¬ 
testing  of  the  function.  When  responses  are  received,  they  will  be  usee  to 
make  constructive  reconmendations  T'or  the  overa’l  integration  and  coordi¬ 
nation  of  planning  and  scheduling  at  ASD. 

Questions  that  are  comon  to  all  organizations  should  be  these: 

1.  Do  the  top  managers  and  staff  of  each  of  these  organizations  have 
readily  available  the  current  scnedule  dates  and  scnedule  status  of  the 
major  milestones  of  the  program  which  are  included  in  their  operational 
responsibility?  It  is  not  possible  for  managers  to  give  proper  priority  and 
direction  to  his  portion  of  a  program  if  he  is  not  aware  of  the  the  s am,, 
schedule  Information  wnicn  nigner  command  must  nave.  Common  major  milestone 
reports  must  be  available  to  the  operating  and  supporting  organizations. 

2.  How  compatible  are  the  planning  and  scheduling  policies  and  procedures 
among  these  organizations?  Lack  of  corononal ity  in  data  gathe-i"?,  sorting, 
and  evaluating  techniques  can  lead  to  serious  inconsistencies  ■>  data  as  it 
is  reported  to  higher  comand.  Unless  definite  ground  rules  o  -'s*  'r  the 
definition  of  activities,  milestones,  status  ana  variance  reports,  tney  will 
have  different  meanings  even  if  they  look  alike  on  the  surface. 

3.  Is  any  one  officer  at  ASD  reviewing,  even  at  a  summary  level,  the 
quality  of  the  planning  and  scheduling  support  that  is  necessary  including 
the  CMD/AFPRO  support?  It  does  not  have  to  utilize  all  of  the  ASD  Program 
Control  methods  as  some  contractors  use,  but  it  should  at  least  request  the 
assistance  of  a  few  people,  on  a  regular  basis,  to  look  at  what  is  happening  ard 
highlighting  problem  areas  with  recommended  solutions. 

Questions  for  some  organizations: 

1.  How  does  the  methodology  used  in  developing  Vanguard  relate  to  other 
efforts  at  program  integration  at  ASD?  Duplication  of  effort  and  redefini¬ 
tion  of  data  categories  and  symbols  can  cause  added  confusion  when  follow-up 
maintenance  is  done  either  on  Vanguard  or  on  its  possible  successors.  Since 
the  Vanguard  methodology  has  been  directed  by  higher  command,  existing  ASD 
practices  may  need  to  be  revised  or  the  differences  clearly  txp’ained  in 
applicable  reports. 

2.  What  Is  the  relationship  of  new  program  plans  to  the  master  plan  for  ASD's 
portion  of  the  USAF  mission,  and  the  ongoing  programs,  or  how  capable  ASD  is 
in  relating  what  is  happening  on  the  ongoing  programs  (status  and  schedule 
forecasts)  to  the  work  it  is  doing  on  new  programs  and  the  master  mission 
plan? 

3.  As  automated  management  systems  are  becoming  operational,  will  the  using 
and  supporting  organizations  have  adequately  resolved  the  differences  which 
always  exist  In  manual  system  or  unique  automated  systems,  so  that  data  com¬ 
patibility  will  exist  in  the  central  system?  The  job  of  initiating  and 
assuring  the  heavy  negotiation  necessary  to  assure  the  necessary  agreements, 
or  conmand  arbitration,  will  be  a  large  cne  and  should  be  given  equal 
priority  to  that  of  developing  the  automated  system  Itself. 
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4.  what  impact  wi 1  the  imp  seme:  tat. ion  of  tne  Independent  Schedule 

Assessment  Program  nave  or.  ire  c-xi  jtiog  data  collection  ana  evaluation 
systems?  ms  large  amounts  of  ^dtrc'n  g  and  processing  continues  to 

become  more  practical,  the  demand  for  an  integrated  master  plan  such  as 
Vanguard,  will  Increase  and  tne  desire  for  implementation  of  tne  ISA,  at 
greater  and  greater  levels  of  detail,  will  increase.  The  maintenance  of 
Vanguard  will  require  a  large  amount  of  data  on  a  regular  and  oependable 
basis.  Are  the  cost  col  lectio  -,  channels  which  provide  data  to  the  cost  cen¬ 
ters  to  the  comptroller  organization  able  to  provide  tne  same  quality  of 
schedule  status  data?  At  the  contractor  level  cost  and  schedule  data  Is 
sometimes  incompatible  and  cost  usually  nas  the  advantage.  The  ground  rules 
for  validating  and  evaluating  schedule  data  is  in  some  ways  different  than 
for  cost  oat  a. 

5.  Is  tne  level  of  quality  ror  schedule  data  received  from  the  contractor 
and  CMD  data  processing  systems,  believed  io  oe  satisf actory?  Inconsistency 
and  inadequacy  should  be  immediately  addressed. 

5.  Are  the  areas  currently  being  measured  for  schedule  performance  adequate 
to  forecast  potential  schedule  trouble  at  a  reasonaole  level  of  accuracy? 

If  schedule  surprises  are  more  tne  rule  tr-an  the  exception,  then  definite 
improvement  snould  be  expected  in  the  oata  reporting  requirements. 

7.  Do  tne  personnel  responsible  for  evaluation  and  guiding  the  program 
planning  and  scheduling  function  nave  adequate  experience  ana  training  in 
tnis  field?  A  program  manager  must  hate  people  who  can  recognize  trends  in 
schedule  slippage,  in  adequate  or  incomplete  data,  ana  evaluate  the 
contractor's  compliance  with  the  reporting  system  such  as  C/SCSC,  with  which 
he  is  supposed  to  oe  complying  in  the  planning  and  scheduling  area. 

8.  Does  che  program  completion  milestones  on  my  programs  have  the  same 
degree  of  validity  as  the  oottom-line  in  the  cost  area?  The  cost  area 
traditionally  receives  more  attention.  The  schedule  evaluation  car  be 
equally  important,  particularly  for  national  security,  compared  to  the 
dollar  evaluation. 

9.  Are  the  Work  Packages  defined  by  the  contractor  adequate  for  accurate 
tracking  and  validation  of  completion?  There  can  be  a  tendency  to  allow 
these  basic  elements  of  a  good  schedule  to  become  vague,  which  will  cause 
the  completion  percentage  progress  report  to  be  equally  vague.  The  contrac¬ 
tor  should  ao  things  according  to  his  best  and  proven  method,  but  it  must 
provide  the  Air  Force  with  usabie  data. 

10.  Do  the  answers  to  the  questions  answered  by  the  other  organizations 
reflect  back  on  the  way  CMD  has  oeen  collecting  and  reporting  the  program 
data  and  what  can  be  done  about  it?  Perhaps  some  of  the  answers  will  be  due 
to  a  lack  of  understanding  on  how  tne  data  can  be  used,  but  data  quality 
appears  to  be  primarily  the  responsibility  of  CMD  with  the  contractor. 

These  questions  reflect  on  the  kind  of  role  these  organizations  should  be 
playing  in  the  planning  and  scheduling  area.  It  is  important  to  try  to  pull  the 
right  answers  to  these  questions  together  and  make  recommendations  for 
improvement.  This  effort  should  not  be  just  a  one-time  effort  but  Is  a  function 
that  the  staff  of  ASD  should  be  doing  on  a  regular  basis  to  maintain  program 
schedule  integrity. 


VI.  CONCLUSIONS 


The  motivation  for  the  Initiative  16  on  "Independent  Schedule 
Assessment"  and  the  Vanguard  AFSC  initiative  surely  includes  a  concern  *or 
the  adequacy  of  the  planning  and  scheduling  function  in  AFSC  and  ASD. 

At  the  beginning  of  this  report,  five  questions  were  raised  as  being 
partially  answerable  by  this  report,  A  summary  of  those  answers,  which  are 
detailed  by  the  contents  of  the  report  itself,  are  as  follows: 

1.  A  definition  of  planning  anc  scheduling  and  the  key  variables  that 
significantly  effect  its  operation  are  discussed  in  detail  in  Section  I. 

2.  The  proper  role  for  planning  and  scheduling  will  become  more  clear  as 
responses  to  this  report  are  gathered  and  follow-on  reports  are  preparer. 
Certainly  the  heart  of  the  answer  is  for  the  P&S  functions  to  carry  o^c  to 
the  fullest  degree  possible  the  spirit  and  letter  of  the  quoted  official 
documents  In  this  report. 

3.  The  Integration  and  coordination  of  the  Independent  Schedule  Assessment, 
project  Vanguard,  and  an  automated  management  information  system  into  the 
planning  and  scheduling  actlvites  Is  one  of  the  objectives  oi  this  reoort  by 
exposing  them  and  interrelating  them  to  each  other  and  other  P" ~  pw; icies, 
activities  and  related  organizations. 

4.  The  role  of  organizations  In  planning  and  scheduling  at  ASD  is  dealt 
with  In  Section  IV.  However,  an  expansion  on  coordinations  of  these  roles 
will  be  dealt  with  in  follow-on  reports  based  upon  responses  to  this  report 
and  the  more  current  environment  that  will  exist  when  this  follow-on  report 
is  prepared.  The  roles  of  P&S  related  organizations  have  been  changing 
rapidly  and  this  report  hopefully  will  continue  a  positive  trend  in  this 
area. 

Questions  concerning  the  planning  and  scheduling  enhancement  opportunities 
at  ASD  have  been  documented  in  Section  V. 

ASD  has  a  good  opportunity  at  this  particular  time  to  assess  its 
planning  and  scheduling  operation  and  the  implementation  of  such  functions 
as  the  "Independent  Schedule  Assessment,"  "Vanguard,"  and  an  "Automated 
Management  System"  could  make  meaningful  improvements.  In  the  spirit  of 
this  recommendation,  this  report  concludes  with  an  outline  of  a  follow-on 
reserve  project  which  will  accomplish  the  following  tasks: 

1.  Perform  a  survey  of  the  applicable  organizations  to  determine  their 
answers  to  the  types  of  questions  asked  in  Section  V. 

2.  Discuss  with  the  responsible  organizations  possible  ways  in  which  the 
ISA,  Vanguard,  and  AMS  could  be  integrated. 

3.  Prepare  specific  recommendations  for  improving  the  ASD  planning  and 
scheduling  operation. 

Planning  and  scheduling  is  of  course  time  management.  Time  Is  not  only 
money,  but  for  the  Air  Force  it  is  also  national  secir  \  If  this  study 
can  contribute  to  greater  savings  and  earlier  performanc?,  its  contribution 
should  be  meaningful . 
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APPENDIX  1 


ASD/AE  MANAGEMENT  SYSTEM  EXAMPLE 

This  excerpt,  from  AEOI  10-1,  dated  31  August  1978,  illustrates 
the  level  of  attention  and  the  importance  of  the  quality  of  the  evaluation 
procedure  and  the  material  reviewed. 

ASO/AE  REVIEWS 


a.  ASD/AE  Corporate  Review  Group  (CRG) :  A  senior  manage¬ 
ment  review  group  that  assures  proper  management  attention, 
consistent  with  available  resources,  Is  given  to  all  ASD/AE 
work  efforts. 

Membership  Is  as  follows: 

ASD/AE  Deputy  -  Chairman 

ASD/AE  Assistant  Deputy 

ASD/AE  Technical  Director 

ASO/AE  Assistant  Deputy  for  Programs 

ASD/AEP  Director 

ASO/AEK  Director 

ASD/AEC  Director 

ASD/AEQ  Director 

NOTE:  The  secretariat  for  all  formal  reviews  by  the  CRB  will  be 
provided  by  ASD/AEP. 

b.  ASD/AE  Briefing  Review  Board  (BRS): 

(1)  A  senior  management  review  group  that  assures  proper 
management  attention  is  provided  to  insure  professional, 
accurate  and  relevant  briefings  to: 

(a)  The  ASD  Council 

(b)  A  General  Officer  Panel/Study  Group 

(c)  A  General  Officer/Equivalent  Grade  Civilian 

(d)  Four-Letter  Symbol  Air  Staff  Elements 

(e)  Three-Letter  Symbol  HQ  AFSC  Staff  Elements 

(2)  Membership  is  as  follows: 

ASD/AE  Assistant  Deputy  -Chairman 

ASD/AE  Technical  Director 

ASO/AE  Assistant  Deputy  for  Programs 

ASD/AEP  Director 

ASO/AEK  01  rector 

ASD/AEC  Director 

ASD/AEQ  Director 

NOTE:  The  secretariat  for  all  formal  reviews  by  the  BRB  will  be 
provided  by  the  three-letter  symbol  office  making  the  prese  tation. 
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c.  C onni and  wsse:  ^ment  R^.-.ew  (CM):  Tnis  review  ’s  set 
forth  In  AFSfift'  850 -I  and-  ATSuk  800-/3 .  Such  reviews  will  be 
presented  to  the  BRB,  CRG,  and  ASO  Council. 

d.  New  Start:  A  prcgram/project  for  which  appropriate 
direction  has  tasked  ASD/AE  to  initiate  either  a  new  program 
or  to  add  new  work  to  an  on-gclng  program. 

e.  New  Start  Review  (NSR):  This  review  assesses  the 
applicability  of  a  new  start  work  effort  to  the  overall 
mission  of  ASO/AE.  In  addition,  the  aval  lability  of  presently 
assigned  manpower,  future  forecast,  ^nd  AsD/AE  available 
•"esources  to  carry  out  the  new  wort  e+fcrt  are  reviewed.  This 
review  is  conducted  by  the  ASD/AE  three- letter  symbol  SPO 
gaining  the  new  work  effort  ano  presented  to  trie  ASO/AE  CRG. 
The  results  of  this  NSR  is  an  ASD/AE  decision  to  proceed  or 
not  proceed  with  the  proposed  new  work  effort. 

f.  Initial  Program  Review  (I3R):  This  review  examines 
management  and  Dusiness  approaches  to  ar  approved  new  start 
effort.  Tnis  review  is  conducted  by  the  cognizant  ASO/AE 
tnree-letter  s>mbol  SPO  and,  if  directed  by  the  NSR,  presented 
to  the  ASD/AE  CRG.  The  purpose  of  this  review  is  for  the 
three-letter  symbol  SPO  to  present  the  results  of  their  pre¬ 
viously  conducted  Business  Strategy  Meetings,  cost  trade-offs 
(if  applicable)  and  other  refined  program  strategy  aspects 
since  the  time  of  the  NSR.  The  cognizant  SPO  should  have  by 
now  selected  alternatives  for  the  successful  conduct  of  their 
NSR  assigned  program,  identified  performance,  cost  arid  sche¬ 
dule  baselines,  and  be  prepared  to  commit  to  measurement 
thresholds. 

9*  Three-Letter  Symbol  Organization  Program  Review 
(TQPR) :  this  review  is  conducted  to  maintain  SPO  management 
cognizance  of  the  status  of  each  ongoing  work  effort. 

h.  Management  Assessment  Review  (MAR):  This  review  is 
conducted  to  provide  Information  concerning  the  status  and 
details  of  existing/ potential  problems  relative  to  established 
cost,  schedule,  technical  performance  baselines,  and  other 
assessment  criteria. 

i.  Program  Management  Review  (PMR):  This  review  provides 
visibilityjnto  program  problem  areas  and  the  attendant  course 
of  'action  for  solution.  In  addition,  topics  of  special 
interest  are  presented. 


direction  of  ASD/AE. 

k.  ASO/AE  Functional  Management  Review  (AE-FMR) :  This 
review  provides  an  overview  of  all  ASD/AE  business  and  a  sum¬ 
mary  of  resource  allocations  to  ASO/AE.  This  review  is  con¬ 
ducted  at  ASO/AE  direction  net  less  than  quarterly  and 
Immediately  preceding  the  ASO  FMR."  (5) 


In  order  to  properly  prepare  for  these  reviews,  the  following  list  of 
charts  are  prepared  for  command  review  briefings,  as  required.  A  quick 
review  of  these  titles  alone  indicate  that  over  half  of  them  are  affected 
by  schedule/cost  factors. 

ASD/AE  Program  Review  Charts 


Prog  Data  Sheet  Chart 
History  Chart 

Prog  Doc/Review  Level  Chart 
Cost  Risk  Chart 

Prog  Funding  Allocations  Chart 

Proc  Actions  Schedule  Chart 

Schedule  Risk  Chart 
System  Performance  Chart 
Prog  Control  Chart 
Life  Cycle  Cost  Chart 

Logistics  Chart 
System  Safety  Chart 
Conflg  Mgt  Chart 
Govt  Furnished  Matls/ 

Facilities  Chart 

Source  Selection  Procedures  Chart 
Alternate  Proc  Approach  Chart 
Should  Cost  Chart 


Personnel  Resources  Chart 
Prog  Direction  Suwnary  Chart 
Development  Funds  Chart 
Production  Funds  Chart 
Prog  Major  Milestone  Schedule 
Chart 

Prog  Schedule  (AFSC  Fm  103) 
Chart 

Threat  Status  Chart 
Tech  Risk/Risk  Reduction  Chart 
Design  to  Cost  Chart 
Integrated  Logistics  Ping 
Chart 

Rel/Maintaln  Chart 
Value  Engrg  Chart 
Item  Test  Summary  C ^ *  r i 
Prod  Readiness  Review  Chart 

Negotiation  Authority  Chart 
Contract  Type  Chart 
PMRT  Chart 


This  Is  an  example  of  how  one  of  the  ASD  SPO's  has  responded 
to  the  planning  and  scheduling  obligation.  Others  have  used 
difference  methods. 
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APPENDIX  2 


ESTIMATING  FUNCTIONAL  SIMILARITIES 

In  order  to  address  the  area  of  planning  in  tne  early  phase  of  a  program 
the  following  excerpt  from  a  Master's  Thesis  Dy  Maj  (USA^)  Edwin  M.  Lewis 
and  Eugene  D.  Pearson  on  "The  Air  Force  Cost  Estimating  Process  is  Provided." 

"Aeronautical  Systems  Division.  ASD  SPOs  generate  cost  esti¬ 
mates  In  all  four  phases  of  the  weapon  system  acquisition 
cycle.  Within  ASD,  the  Directorate  of  Cost  Analysis,  Advanced 
Systems  Division  (ASD/ACCX)  is  responsible  for  generating  the 
cost  estimates  in  tne  conceptual  pnase.  The  SPOs,  which  are 
formed  toward  the  end  of  the  conceptual  phase,  use  the  estimates 
generated  by  ASD/ACCX  as  their  own  estimate  for  that 
phase.  The  SPO  personnel  generate  their  own  estimates  in  the 
remaining  phases.  'ASD/ACCX  does  the  initial  phase 
estimating.'  Therefore,  ASD/ACCX  Is  considered  by  ASD  per¬ 
sonnel  to  be  the  SPO  for  the  major  portion  of  the  conceptual 
phase.  They  work  on  pre-ROC  studies  and  conduct  studies  to 
meet  the  ROC  after  it  Is  developed. 

The  amount  of  data  available  for  use  by  the  estimators 
influenced  the  type  of  technique  used  to  a  great  extent. 

Personnel  from  one  SPO  emphasized  this,  claiming  'The  tech¬ 
nique  used  is  driven  by  the  amount  and  type  of  data 
available.'  The  ASD  SPO  estimators  use  parametric  esti¬ 
mating  techniques  in  the  conceptual  and  validation  phases. 

The  RCA  PRICE  model  is  used  for  estimating  electronic 
equipment.  CERs,  expert  opinion,  and  analogies  are  relied 
upon  quite  heavily  for  generation  cost  estimates  in  both  of 
these  phases.  An  attempt  is  made  to  correlate  design  parame¬ 
ters  to  nistorical  cost  data  from  other  programs  and  arrive  at 
the  estimated  cost  of  the  new  weapon  system.  In  the  full 
scale  development  phase,  the  estimators  use  some  parametric 
techniques,  but  begin  to  rely  on  engineering  techniques.  They 
are  able  to  use  detailed  engineering,  statistical  (grass 
roots),  marginal  analysis  and  trend  analysis  techniques. 

Prototype  weapon  systems  have  been  developed  and  produced, 
yielding  a  much  greater  oaf a  base  to  work  with.  The  estima¬ 
tors  also  have  the  work  break  down  packages  from  the 
Cost/Schedule  Control  Systems  Criteria  (C/SCSC)  available  for 
the  weapon  system  they  are  working  on.  This  added  data  base 
allows  the  estimator  to  use  the  engineering  techniques.  In 
tne  production  phase,  actual  production  data  is  available. 

Historical  standard  time/cost  by  task  and  historical  trends 
are  used  to  generate  the  cost  estimates  during  this  phase 
(47). 

Cost  estimates  are  generated  by  the  ASD  SPOs  for  a  variety  of 
reasons,  the  primary  ones  being  for  program  advocacy  to  the 
AFSARC  and  DSARC  and  fo”  budget  preparation.  Cost  estimates 
are  also  used  for  program  control  and  adjustment,  'what  if’ 
contingency  reviews,  and  in  support  of  source  selection  and 
contract  negotiations.  In  the  conceptual  and  validation 
phases,  the  cost  estimates  are  used  in  making  comparisons 


,  V. 
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between  the  different  weapon  systems  under  consideration.  The 
cost  estimates  give  the  decision  makers  at  the  Air  Staff  and 
000  a  gross  idea  of  the  costs  involved  to  achieve  a  certain 

capability. 

In  summary,  the  ASO  SPOs  validate  the  model  in  all  areas 
except  technique  used.  The  ASD  SPOs  make  cost  estimates  in 
the  conceptual,  validation,  full  scale  development,  and  pro¬ 
duction  phases  of  the  weapon  system  acquisition  cycle.  The 
amount  of  data  available  for  generating  cost  estimates  grows 
from  very  little  (vague)  to  extensive,  production  data 
(historical).  The  quality  and  quantity  of  data  grows  as  the 
weapon  system  progresses  through  the  cycle  while  the  risk  and 
the  time  over  which  estimates  are  required  to  be  valid 
decreases.  The  SPOs  make  estimates  for  two  major  reasons-- 
program  advocacy  and  budget  generation.  In  the  area  of  tech¬ 
niques  used,  the  ASD  SPOs  use  parametric  estimating  techniques 
to  generate  cost  estimates  in  the  conceptual  and  validation 
phases.  They  use  research  and  development  and  engineering 
techniques  in  the  full  scale  development  phase,  and  standards 
techniques  in  the  production  phase.  The  type  of  technique 
used  is  dependent  upon  the  amount  of  data  available.  The 
individual  estimator  chooses  which  technique  he  will  use  based 
upon  his  interpretation  of  the  amount  of  data  available."  {/) 
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APPENDIX  3 

INITIATIVE  16  TEAM  MEMBER  ASSESSMENT 

This  section  Includes  a  copy  of  an  Initiative  16  Team  memDer  report  pre¬ 
pared  after  his  Interviews  of  some  ASD  SPOs.  This  report  is  of  course  only 
one  man's  opinion.  But  It  may  offer  some  good  clues  as  to  some  current 
strengths  and  weaknesses  in  ASD  in  the  planning  and  scheduling  area.  It  was 
written  In  June  of  1978  by  Lt  John  R.  McNally  of  ASD. 

"SUBJECT:  Command  Initiative  16,  Improve  the  Quality  of 
Program  Schedules. 

1.  I  have  completed  the  review  of  ASD  program  offices  with 
regards  to  what  methods  are  used  for  schedule  assessment. 

Since  ASO  has  representation  from  both  AC  and  PM,  my  efforts 
centered  on  the  ASD  manufacturing  community.  However,  I  did 
interview  some  program  managers  and  the  F-16  focal  point  for  . 
schedules  in  Program  Control  (ASD/YPPP). 

2.  During  my  interviews,  all  personnel  stated  that  there  was 
no  formal  method  presently  oeing  used  to  analyze  schedules. 

In  most  offices.  Program  Control  receives  scheduling  inputs 
from  the  functional  areas  to  establish  the  master  schedule, 
however,  there  is  no  further  analysis  of  the  schedule.  Except 
for  the  people  in  ASD/YP,  the  personnel  interviewed  were  not 
aware  of  which  office  within  Program  Control  was  responsible 
for  schedule  analysis.  In  ASD/AE  the  individual  program 
managers  were  responsible  for  the  schedule.  They  rely  on 
experience  and  do  not  perform  a  formal  schedule  analysis.  The 
primary  reasons  given  for  lack  of  schedule  analysis  at  ASD 
were: 


a.  The  schedule  was  established  by  the  PMD  and  it  is 
easier  in  most  cases  to  live  with  it  than  to  try  to  change  it 
and  possibly  end  up  further  behind  schedule. 

o.  In  the  case  of  the  F-16,  the  schedule  was  established 
in  a  large  part  by  State  Department  agreements  and  cannot  be 
changed. 


c.  The  experience  with  a  particular  contractor  does  not 
warrant  a  detailed  analysis  when  the  contractor  says  he  can 
meet  a  schedule. 

3.  Experience  with  a  contractor  ana  system,  knowledge  of  the 
product  and  judgement  were  three  qualities  that  those  inter¬ 
viewed  believed  were  essential  for  analyzing  schedules  and 
unless  an  individual  had  considerable  knowledge  and  experience 
he  could  not  evaluate  schedule  realism.  The  experience  of  an 
individual  will  dictate  whether  or  not  program  leadtimes,  e.g. 
procurement,  were  realistic  and  sufficiently  addressed.  Since 
there  was  no  formal  method  used  for  schedule  analysis,  the 
majority  of  people  relied  heavily  on  the  contractor's  schedule 
as  well  as  their  own  experience.  Manufacturing  In  some 
instances  used  the  Line  of  Balance  technique.  However,  they 


also  generally  relied  on  the  contractor's  schedule  except  for 
the  long  lead  items  which  were  more  thoroughly  analyzed. 


4.  During  the  Interview  the  people  were  questioned  concerning 
what  factors  would  be  necessary  to  address  if  a  formal  method¬ 
ology  could  be  developed. 

Some  stated  that  a  formal  method  was  Impractical  due  to  the 
variations  in  programs.  Others  favored  a  checklist  type  of 
approach  which  would  still  rely  on  an  individuals  experience. 
Those  who  did  feel  it  could  be  achieved  recotnnended  that  in 
addition  to  performance  factors  that  the  Air  Force  experience 
with  a  particular  contractor,  the  contractor's  experience  and 
long  lead  Items  some  how  be  recognized.  These  items  should 
then  be  tied  into  cost  and  program  phase. 

5.  Following  are  my  conclusions  as  a  result  of  the  survey: 

a.  No  formal  method  is  being  used  at  ASD  to  analyze 
master  program  schedules. 

b.  Experience  is  essential  to  schedule  analysis  and  the 
individuals  experience  will  dictate  whether  or  not  a  schec: ' 
is  realistic. 

c.  Manufacturing  approaches  a  formal  analysis  by  using 
the  Line  of  Balance  technique,  but  they  still  rely  heavily  on 
contractor  inputs. 

d.  Attitudes  are  divergent  on  the  practicality  of 
establishing  a  formal  schedule  analysis  methodology. 
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ArFENOIX  4 


INITIATIVE  16  TEAM  AFPRO  REPORT 

When  the  Initiative  16  team  did  a  survey  of  the  AFPRO's  concerning 
whether  they  performed  schedule  assessments  the  following  results  were 
reported. 

SUMMARY  OF  AFPRO  RESPONSES 

Tc 

INITIATIVE  #:6  QUESTIONS  ON  CURRENT  METHODOLOGY  USED 

1.  Dees  the  AFPRO  have  a  structured  program  schedule 
assessment  technique/methodology? 


The  AFPROs  do  not  have  a  structured  technique/methodology 
except  for  the  standard  systems  required  on  contract  as 
C/SCSC,  Line  of  Balance,  etc.  Our  personnel  evaluate  contractor 
provided  data  and  supporting  rationale  to  determine  whether 
near  term  schedule  can  be  achieved.  When  the  AFPROs  are 
requested  to  review  contractor  plans  during  early  acquisition 
phase  by  Pre-Award  Survey  and  Manufacturing  Management/ 

Production  Capability  Review,  time  restrictions  inhibit 
detailed  analyses  of  overall  prog?- am  milestone  schedules. 

2.  Is  tne  schedule  assessment  methodology  documented? 

No,  not  in  the  context  of  a  methodology  for  assessing 
acnievability  and  accuracy  of  overall  program  milestones. 

3.  What  individual  (or  office)  is  most  knowledgeable  of  the 
application  of  the  schedule  assessment  methodology? 

Data  is  available  at  HQ  AFCMD/PD  for  whoever  desires  the  information. 

4.  How  is  the  schedule  assessment  information  applied  or  used 
(Source  selection,  PAS,  MM/PC,  CMR,  etc.). 

The  information  is  provided  to  the  buying  activity  for 
the  above  reviews. 

5.  What  offices  (AFPRO  internal,  AFCMD,  SPO,  etc.)  use  the 
schedule  assessment  Information? 

The  AFPRO  functional  offices  use  the  information  and  it  Is 
also  provided  to  the  SPO  for  visibility  of  schedule 
achievement. 

6.  How  is  the  scnedule  assessment  data  generated  (i.e., 
parametrics,  grass  roots,  analogy,  modeling,  etc.) 

Generally,  contractor  generates  data  by  grass  roots  method 
or  analogy  comparison  with  prior  completed  systems.  AFPRO 
personnel  analyze  the  contractor's  back-up  data  to  assess 
whether  planned  milestones  are  achievable. 


7.  Does  the  nature  of  the  program/project  (conceptual, 
validation,  FSD,  production)  impact  the  application  of  the 
schedule  assessment  methodology  or  the  accuracy  of  its 
output? 

Yes,  there  is  more  accuracy  in  the  schedule  assessment 
data  as  the  program/project  nears  the  end  of  the  acquisition 
life  cycle. 

8.  Is  the  schedule  assessment  methodology  appropriate  for 
near-term  schedule  analysis  vs  DSARC  milestone  schedule 
analysis  or  both? 

Our  capabilities  are  directed  more  to  near-term  schedule 
assessment  of  contract  tasks  and  end  item  deliveries  rather 
than  overall  program  milestones.  This  is  within  the  purview 
of  program  office  responsibility. 

9.  What  is  the  primary  deficiency  in  present  program  schedule 
assessment  techniques/methodologies  being  used  by  the  AFPRO? 

a.  Evaluators  must  be  more  knowledgeable  of  contractor 
operations  and  management  systems.  Better  training  courses 
are  needed  in  this  area. 

b.  Resources  aren't  available  to  maintain  and  update 
historical  data. 

c.  Real  time  information  is  needed. 

10.  What  techniques  do  contractors  use  to  evaluate  a 
subcontractor's  projected  schedules? 

Contractors  use  Pre-Award  Surveys  to  evaluate  a 
subcontractor’s  capability  to  meet  schedules.  They  also  rely 
on  their  past  experiences  with  known  subcontractors.  (1) 

AFPRO  REPORTS  RELATED  TO  P&S 


The  AFCMD/ AFPRO  uses  many  methods  to  accomplish  his  mission.  Three  of 
them  are  the  Production  Plan,  the  Production  Progress  Report,  and  the 
Production  Analysis  Report.  These  reports  are  described  as  follows: 

1.  Production  Plan  -  The  Production  Plan  permits  evaluation 
of  make-or-buy  proposals  and  manufacturing  capability,  in  con¬ 
junction  with  the  contractor's  planning  to  support  the 
development/production/testing  efforts  associated  with  a  pro¬ 
posed  program.  This  Is  applied  primarily  In  the  Definition 
Phase  on  complete  systems  and  GFAE  equipment/subsystem 
programs. 


General  Procedures: 


A  production  plan  shall  be  prepared  portraying  methods  and 
concepts  for  employing  facilities,  tooling,  and  manpower 
resources  of  the  contractor  and  subcontractors.  It  reflects 
all  time-phased  production  actions  required  to  produce,  test, 
Inspect,  and  deliver  acceptable  contractual  end  Items  on  sched¬ 
ules  and  at  minimum  cost. 

Production  Planning 

a.  Delivery  Schedule.  Depict  the  proposed  delivery  schedule 
for  all  end  items  to  be  producec  to  support  the  proposed 
program,  to  include  test  articles  and  operational  end  items. 

b.  Manufacturing  Leadtime.  Depict  the  relationship  of 
time-phased  milestones  fur  in-plant  and  subcontracted  effort 
from  contract  qo-anead  to  delivery  of  the  first  end  item. 
Manufacturing  leadtime  to  meet  the  initial  production  block 
release  quantity  and  the  total  schedule  will  be  depicted  to 
indicate  those  items  which  require  prebuy  funding  release  or  a 
specified  contract  go-ahead  date,  in  order  tc  meet  the  pro¬ 
posed  delivery  schedule. 

c.  Master  Phasing  Chart.  Provide  a  Master  Phasing  Chart 
depicting  milestones  for  each  element  that  controls  time 
phasing  of  the  total  program  to  meet  the  projected  schedule. 

This  chart  should  include  major  elements  such  as  contract 
awarded  research/development  testing,  materials  procurement, 
tooling,  facilities,  GFAE  deliveries,  fabrication, 
subassembly,  assembly,  production  testing,  and  delivery  of  end 
items. 

d.  Production  Control.  Provide  an  explanation  of  the 
existing  or  proposed  production  control  system.  Details  of 
the  system  should  be  outlined  to  ensure  that  the  planned 
program  can  be  accomplished.  The  relationship  between  con¬ 
figuration  control,  quality  control,  and  production  control 
will  be  explained.  The  plan  to  consolidate  related  data  in  an 
Integrated  Records  System  will  be  provided. 

e.  Manufacturing  Plan.  Provide  a  manufacturing  plan  uti¬ 
lizing  a  gces-into  chart,  tree  chart,  or  equivalent  to  portray 
the  planned  process  of  manufacturer  and  assembly  in  terms  of 
key  plan  operations  or  assembly  points  showing  their  total  and 
individual  leadtimes,  from  procurement  of  raw  material  to 

ae livery  of  the  end  Item  (i.e.,  one  management  tool  that  may 
be  used  to  portray  and  measure  a  manufacturing  plan  in  the 
"Line  of  Balance"  method  or  technique.) 

f.  Experience: 

(1)  Provide  a  listing  of  types  of  items  or  systems 
produced  within  the  past  five  years  that  are  comparable  In 
size/complexity  to  the  items  specified  in  the  acquisition 
phase  work  statement. 
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(2)  Provide  in  chart  form  contractor  past  performance 
within  the  past  five  years  to  include  (a)  number  and  type  of 
contract,  (b)  item  description,  (c)  quantity,  (d)  total  dollar 
amount,  (e)  percentage  of  underrun,  (f)  percentage  of  overrun, 
(g)  percentage  of  on-time  delivery  (monthly-rate),  and  (h) 
contractor's  ability  to  meet  technical  requirements. 

2.  Production  Progress  Report  -  For  providing  production 
status,  identification  of  production  deficiencies,  or 
delinquencies,  incipient  problem  areas,  and  other  significant 
facts  relating  to  the  qualitative  and  timely  delivery  of 
contract  items  to  the  Government.  Applicable  for  inclusion  in 
any  contract  requiring  status  reporting  on  contract  line 
items. 

3.  Production  Analysis  Report  -  This  is  used  to  (a)  graphi¬ 
cally  portray  the  progress  made  in  the  fabrication, 
procurement,  and  assembly  of  end  items  and  major 
subassemblies;  (b)  show  deficiencies  and  overages  of  raw 
materials,  parts,  and  subassemblies;  (c)  depict  the  status  of 
manufacturing  operation  necessary  to  fulfillment  of  the 
contract;  and  (d)  identify  sources  of  difficulty  or  delays  in 
production  before  the  trouble  becomes  acute. 

This  normally  applied  during  the  acquisition  phase. 
Preparation  Instructions 

1.  The  contractor  shall  prepare  a  production  analysis  report 
setting  forth: 

a.  Schedule  and  Delivery  of  End  Items  consisting  of: 

(1)  A  graphic  chart  of  the  end  item  contract  delivery 
schedule,  in  quantities,  by  month,  for  items  on  contract.  In 
addition,  another  line  will  show  the  end  item  cumulative  net 
position  through  the  current  month  and  a  forecast  of  accep¬ 
tance  for  the  next  6  months,  by  month.  Whenever  the  forecast 
deviates  from  the  contract  schedule,  a  minus  sign  (-)  shall 
indicate  "behind  schedule"  and  plus  sign  (+),  "ahead  of 
schedule." 

(2)  A  bar  chart,  depicting  the  cumulative  number  of 
end  items  that  have  been  accepted. 

b.  Stock  Position  and  Balance  Line.  All  figures  will  be 
expressed  In  terms  of  end-item  sets.  TFTe  line  of  balance  will 
show  the  status  required  for  each  of  the  control  points  as  of 
the  date  of  observation.  It  will  show  the  level  of  material, 
parts  of  major  assemblies  needed  to  support  on-schedule 
production.  The  actual  status  will  be  plotted  for  each 
control  point.  The  height  of  the  bar  for  each  control  point 
is  determined  by  cumulative  receipts  as  oi  the  date  of 
observation.  This  cumulative  quantity  will  always  be  expressed 
in  sets.  The  item  will  not  be  counted  unless  complete  in 
every  detail. 
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c.  Production  Plan.  The  contractor  will  prepare  a  flow 
diagram  which  represents  the  respective  leadtimes  of  each  of 
the  established  production  control  points  schematically 
depicting  the  entire  production  operation.  These  control 
points,  which  represent  homogeneous  groups  of  materials, 
components,  and  major  assembly  or  fabrication  operations 
required  In  the  manufacture  of  a  system  or  major  component  of 
a  system,  will  be  numbered  in  sequence  from  left  to  right. 

The  leadtimes  for  these  points  will  be  shown  grapnlcally 
against  a  time  scale  at  the  bottom  of  the  chart.  All  time 
phasing  will  be  expressed  In  leadline  prior  to  final  accep¬ 
tance  of  the  end  item.  Management  nay  Include  as  much  detail 
as  desired.  However,  it  is  desirable  to  avoid  unnecessary 
detail  and  Include  only  the  most  important  steps  in  the  pro¬ 
duction  plan. 

2.  A  narrative  statement  will  accompany  the  Production 
Analysis  Report  and  contain  data  on  each  shortage  or  problem 
reported  on  the  Production  Analysis  Report,  In  the  following 
outline: 


a.  A  brief  statement  as  to  the  difficulty  being  encountered 
on  all  items  below  the  line  of  balance. 

b.  Action  taken  to  alleviate  the  problem.  A  statement  as 
to  the  corrective  action  being  taken  with  forecast  "get  well" 
dates. 


c.  Forecast  recovery  date.  Any  other  pertinent  Infor¬ 
mation  of  the  problem  which  the  contractor  thinks  should  be 
brought  to  the  attention  of  management.  (?) 
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APPENDIX  5 


VANGUARD  PLANNING  AREAS 


A.  MISSION/SUB-MISSION 

1.  Strategic  Offense 

2.  Strategic  Defense 

a.  Atmospheric  Surveillance  and  Warning 

b.  Atmospheric  Threat  Engagement 

c.  Ballistic  Missile  Defense 

d.  Space  Defense 

e.  Anti-Satellite 

3.  Counter  Air 

a.  Conmand  and  Control  Countermeasures 

b.  Offensive 

c.  Defensive 

4.  Air  to  Surface 

a.  Defense  Suppression 

b.  Fixed  Targets 

c.  Non-FI xed  Targets 

5.  Airlift 

a.  Intertheater 

b.  Intratheater 

c.  Support 

6.  Recc/ Intel 

a.  Reconnaissance 

b.  Surveillance 

c.  Correlation/Fuslon 

7.  C3 

a.  Strategic 

b.  Tactical 

c.  Support 


B.  MAJOR  FORCE  ELEMENTS 

1.  Strategic  Offensive  Aircraft 

2.  Fighter/Fighter  Bombers 

3.  I CBM 
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In  Figure  A5-1  Is  shown  an  example  of  a  Vanguard  illustrated  chart.  The  com¬ 
parison  to  a  surnnary  level  CPM  bar-graph  is  evident.  With  the  associated 
back-up  and  the  ability  to  maintain  that  back-up  with  an  ISA  and  automated 
management  data  collection  and  sorting  system,  the  capacity  for  an  integrated 
ASD  planning  and  scheduling  system  significantly  improves. 


FUNCTIONAL 

1.  Propulsion 

2.  Avionics 

3.  RPV-Drones 

4.  EW 

5.  Conventional  Armaments  and  Missiles 

6.  Nuclear  Munitions 

7.  Space 

8.  Computer  Resources 

MAJOR  AREA  OF  IMPROVEMENT 

Operational  Readiness 
Sortie  Generation  Rate 
Reliability 
Maintainability 
Weather 

Target  Acquisition 
Navigation 
Survivability 
Ground 
Air 

Payload-Range 
Accuracy 
Weapon  Effects 
Cost 

ROT&E 

Production 
Operation  &  Support 
Flexibi lity 
Frequency  Coverage 
Response  Time 
Energy 

Productivity 
Weight  Reduction 
Safety 

Product  Improvement 

Endurance 

Other 


FIGURE  A5-1 
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APPENDIX  6 


"SMART"  USERS  DIRECTORY 

Suumary  Management  Assessment  Review  Trends  (SMART) 

Program  Data  Base 

1.  Introduction.  The  automated  Product  Division  portion  of  the  Command 
Management  Information  System  (CMIS)  is  a  macroscopic  management  tool 
used  by  the  Hq  AFSC  Conmand  Section,  Hq  AFSC  staff  level.  Product 
Division  Command  level,  and  at  all  lower  management  levels  to  provide 
corporate  Information  on  programs  for  which  AFSC  Product  Divisions  are 
responsible.  The  system  Is  called  SMART-D  and  fulfills  Level  2  and  Level 
3  CMIS  requirements.  Access  to  the  unclassified  portions  of  the  data 
base  by  HQ  AFSC  personnel  is  unlimited.  Access  by  Product  Division  per¬ 
sonnel  is  limited  to  Information  on  their  respective  Product  Divisions. 
This  information  is,  however,  FOR  OFFICIAL  USE  ONLY  and  is  not  releasable 
to  non-AIr  Force  personnel  such  as  contractors.  Updates  will  be  made  as 
Indicated  In  the  Instructions  that  follow.  NO  CLASSIFIED  INFORMATION 
will  be  entered  In  this  system. 

2.  General.  The  Summary  Management  Assessment  Review  Trends  (SMART) 
program  I n# orm at i on  file  is  a  comprehensive  data  base  of  info-rat" .r,  at 
the  program  level.  This  Users  Directory  describes  the  items  in  the  data 
base,  describes  the  source  to  be  used  for  obtaining  the  required 
information,  and  establishes  the  number  of  characters  permitted  in  each 
data  field.  (12) 

The  data  elements  to  be  included  in  SMART  are  as  follows: 

Status 
Short  Title 
Program  Element 
Project 
Task 

Program  Manager 
Product  Division 
Organization 
Gaining  Organization 
Long  Title 
Phone  number 

Air  Force  Precedence  Rating 
Acquisition  Life  Cycle 
Requirement  (Operational  capability) 

Program  Management  Directive 
AFSC  Form  56  Direction 
Description 

AFSC  Systems  Staff  Officer 
SYSTO  Office  Symbol 

Assessment  Codes,  "N"  -  Not  Applicable,  "S"  -  Satisfactory, 

"IP  -  Unsatisfactory,  and  not  evaluated,  are  used 
In  the  following  areas  of  concern: 

1.  System/Technical  Performance  (STP) 

2.  Funding  (FUND) 

3.  Cost  Performance  (COST) 


U 


4.  Schedule  (SCH) 

5.  Controls  (CONT) 

6.  Manning  (MAN) 

7.  Logistics  (LOG) 

8.  Operations  and  Training  (OPT) 

9.  Testing  (TEST) 

10.  Key  Decisions  (KDEC) 

11.  Program  Direction  (PDIR) 

12.  Integration- Interface  (IN7) 

13.  Threat  Status  Requirement  (TSR) 

14.  Transfer/Program  Management  Responsibility  Transfer  (PMRT) 

15.  Design  to  Cost  (DTC) 

16.  Baseline  Status  (BLS) 

Over  forty  (40)  different  data  categories  are  included  in  the  program 
and  about  eighty  (80)  additional  data  categories  are  recognized. 

When  classified  data  and  other  modifications  can  be  included,  it  is  hoped 
that  SMART  can  be  a  direct  data  source  for  Vanguard. 

Before  completing  the  SMART  review,  the  following  excerpt  from  the  eval¬ 
uation  guide  for  program  schedule  status  will  be  helpful  for  this 
reports  completeness. 

£.  SCH  «  Schedule.  Compare  progress  to  date  with  the 
approved  schedule  or  milestones.  The  impact  of  schedule 
variations  on  initial  operational  capability  or  need  dates 
and  upon  costs  must  be  considered.  Various  fields  for  major 
milestone  dates  are  in  the  SMART  data  base.  These  fields  are 
described  in  (23)  through  (67)  below.  The  assessment  of  the 
schedule  should  be  particularly  sensitive  to  the  status  of  the 
program  in  meeting  the  AFSC-directed  baseline  dates. 

Thresholds: 

Satisfactory— Program  has  met  or  is  predicted  to  meet  all 
established  program  master  schedule  (milestone)  dates. 

Marginal— Program  has  failed  or  is  expected  to  fail  to 
meet  milestone  date(s).  A  plan  has  been  devised  wherein 
action  can  be  taken  under  local  authority  to  get  back  on 
schedule;  or,  flexibility  within  the  program  can  absorb  the 
slippage  without  impacting  critical  milestone  dates  such  as 
tne  initial  operational  capability  (IOC)  date. 

Unsatisf actory— Program  cannot  meet  critical  milestone 
dates  on  the  master  program  schedule.  The  program  slip  cannot 
be  remedied  and  the  master  schedule  must  be  rebaselined.  The 
program  will  not  meet  PMD/AFSC  Form  56  directed  dates. 

This  concludes  tne  section  on  what  is  happening  now  as  ASD  related  to 
planning  and  scheduling.  The  next  section  will  deal  with  who  is  doing  it 
and  some  questions  about  how. 


OF*.**'? 


r 


V 


T 


APPENDIX  7 

PLANNING  AND  SCHEDULING  METHODOLOGIES 


The  following  three  planning  and  scheduling  concepts  have  been  used  in  industry 
for  some  time.  Milestones  techniques  and  bar  charts  are  the  oldest  methods. 
Network  techniques  have  come  as  a  result  of  defense  and  space  complex  programs. 
Parametric  scheduling  interest  has  been  increasing  with  the  greater  use  of  the 
computer  and  the  collection  of  large  data  banks.  These  methods  will  be 
reviewed,  beginning  with  the  last  one  first.  These  reviews  are  a  collection  of 
excerpts  from  the  Initiative  16  effort. 

A.  Parametric  Techniques 

A  parameter  is  a  physical  or  performance  property  whose  value  will  define  a 
particular  characteristic  of  a  system.  A  set  of  properly  selected  parameters 
will  describe  the  system  and  its  operating  characteristics.  An  example  is  the 
maximum  velocity  at  which  an  aircraft  must  travel  which  may  be  used  to  predict 
the  spantimes  required  to  achieve  various  schedule  milestones.  Physical  and 
performance  characteristics  and  the  actual  spantimes  required  to  accomplish 
certain  milestones  are  used  in  multiple  regression  analyses  to  develop  equations 
that  best  fit  the  input  data  base. 

This  section  presents  physical  and  performance  characteristics  as  potential 
data  base  candidates.  It  also  defines  each  characteristic  or  parameter. 

The  evolution  of  an  aerospace  program  may  be  started  with  a  document  called 
Statement  of  Requirements  (SOR).  This  SOR  is  analyzed  and  mission  objectives 
and/or  requirements  are  formalized  from  which  candidate  concepts  are  synthe¬ 
sized  and  evaluated  through  Engineering  trade  studies.  These  trade  studies 
evaluate  performance  versus  cost,  time  to  acquire,  and  risk  in  order  to  obtain  a 
harmonious  balance.  The  more  desirable  concepts  are  then  evaluated  at  a  lower 
level  until  a  final  best  configuration  is  selected. 


Physical  and/or  performance  parameters  for  aircraft  prograr  *  are: 


a.  Thrust.  This  is  the  thrust  required  for  an  aircraft  to  perform  its 
assigned  mission.  One  of  the  difficulties  of  obtaining  the  required  thrust  is 
the  amount  of  space  allotted  for  the  propulsion  system,  e.g.,  single  vs  multiple 
engines. 


b.  Velocity.  This  is  the  maximum  velocity  that  the  aircraft  is  expected  to 
obtain  in  its  operational  environment.  This  is  a  measure  of  the  combined  effi¬ 
ciency  of  airframe  and  propulsion  design  and  the  airframe  structural  complexity. 

c.  Altitude.  The  altitude  at  which  an  aircraft  will  operate  will,  to  a 
large  degree,  effect  the  aerodynamic  design  of  the  airframe  and  the  required 
operating  characteristics  of  the  propulsion  system. 

d.  Acceleration.  This  parameter  combines  the  effects  of  thrust, 
aerodynamics,  size,  and  weight.  An  aircraft's  primary  mission  will  dictate  how 
fast  an  aircraft  must  be  able  to  accelerate  to  a  certain  velocity. 
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e.  Range.  Tne  unrefueled  range  of  an  aircraft  is  a  measure  of  the  engine 
and  airframe  efficiency  and  the  size  of  the  aircraft. 

f.  Weaponry/Payload  (useful  load).  This  parameter  may  dictate  the  struc¬ 
tural  efficiency  of  the  airframe  required  to  meet  designated  lead  carrying  and 
capability.  To  meet  this  factor,  sophisticated  materials  and  manufacturing  may 
be  required  to  obtain  minimum  aircraft  weight  while  maintaining  structural 
Integrity. 

g.  Operating  Characteristics  Factor.  This  parameter  considers  the  effect 
that  operational  requirements  such  as  V/STCL,  use  of  unimproved  runways,  and 
maneuverability  characteristics  have  on  development.  These  factors  typically 
effect  one  subsystem  more  than  the  rest,  e.g.,  unimproved  runways  may  require  a 
different  landing  gear  system  than  if  the  aircraft  was  designed  to  operate 
exclusively  from  improved  runways. 

h.  Advance  Development  Factor.  This  is  a  measure  of  whe  amount  of  aovanced 
development  required  to  meet  stated  performance  requirements.  This  is  espe¬ 
cially  critical  in  subsystems  development,  e.g.,  avionics  or  propulsion  where 
these  subsystems  may  be  a  pacing  item.  Often,  off  the  shelf  or  modified  off  the 
shelf  components  and  materials  may  be  used  in  lieu  of  new  developments.  In  such 
cases,  the  impact  of  this  factor  would  be  significantly  reduced. 

i.  System  Complexity  Factor.  The  system  complexity  has  two  main  segments, 
the  structural  complexity  and  subsystem  integration  complexity.  The  structure 
complexity  factor  is  defined  in  the  TER's  report  by  Vought.  The  integration 
complexity  is  a  measure  of  the  difficulty  in  Integrating  the  numerous  subsystems 
to  obtain  the  desired  performance  characteristics.  The  complexity  of  the  system 
will  not  only  effect  the  development  cost  and  schedule,  but  also  the  production 
cost  and  schedule. 

2.  In  addition  to  the  nine  primary  parameters,  there  are  four  secondary  parame¬ 
ters  which  effect  development.  These  parameters  combine  with  each  other,  the 
primary  parameters  or  other  design  features  to  impact  the  development  schedule. 
These  parameters  will  typically  have  a  direct  impact  on  the  development  schedule 
when  extremes  are  required.  However,  there  will  generally  be  a  direct  effect  on 
the  detailed  design  and  production.  The  four  parameters  are: 

a.  Size.  Generally,  unless  the  size  is  extreme,  e.g.,  C5A,  it  will  not 
have  a  direct  bearing  on  the  development  schedule.  However,  the  size  will 
effect  both  detailed  design  and  manufacturing.  As  the  size  increases  more  time 
will  be  required  for  detailed  design  and  drawings.  The  size  will  also  Influence 
production  tooling  and  leadtime. 

b.  Weight.  The  weight  of  the  aircraft  is  a  function  of  size,  material  and 
other  equipment  necessary  for  the  aircraft  to  perform  its  mission.  If  the  size 
and  weight  are  critical  factors,  then  advanced  materials  and  processes  may  be 
required.  This  in  turn  may  Impact  the  development  and  production  schedule. 

c.  Number  of  engines.  This  parameter  reflects  the  complexity  of  the  pro¬ 
pulsion  system.  The  ability  to  use  multiple  engines  may  permit  the  use  of 
existing  engines  in  lieu  of  newly  developed  ones.  However,  as  the  number  of 
engines  used  on  an  aircraft  Increase,  so  does  the  difficulty  in  getting  the  pro¬ 
pulsion  system  to  function  like  a  unit  rather  than  Individual  engines. 


d.  Maximum  Surface  Temperature.  This  parameter  Is  a  function  of  velocity 
and  altitude.  The  surface  temperature  may  be  a  critical  factor  when  considering 
material,  construction  and  process  selection.  The  temperature  will  also 
influence  the  system  design  and  consequently  the  design  complexity. 

3.  One  other  factor  which  is  not  a  characteristic  of  the  system  but  may  effect 
both  development  and  production  is  the  availability  of  facilities.  This  includes 
manufacturing,  tests,  and  other  essential  development  equipment.  Facilities 
acquisition  or  construction  often  requires  well  over  a  year  before  it  is  ready 
for  use.  The  need  for  additional  facilities  must  be  identified  early  enough  to 
permit  acquisition,  otherwise  development  and  production  schedule  difficullties 
are  sure  to  arise. 


PARAMETRIC  —  STRENGTHS  AND  WEAKNESSES 


1.  Validity 


Good  In  Conceptual  and 
development  phases 


May  overlook  important 
schedule  constraints 


2. 


3. 


4. 


5. 


6. 


Reliability 

Reliability  is  Quanti¬ 
fiable  in  statistical 
terms 

Projects  past  errors 

Implementation 

Proven  techniques  have  been 
developed  which  facilities 
use 

May  require  use  of 
complex  statistical 
technique 

Universality 
of  project 
coverage 

May  be  applied  to  a  broad 
class  of  products 

Requires  Adjustments 
for  comparability 

Sensitivity 

testing 

(simulation) 

Ideally  suited  to 
testing  and  modeling 

Forecasting 

Able  to  forecast  program 
schedules  for  R&D  efforts 

Vought  Missiles  and  Space  Company  (VMSC)  has  developed  a  parametric  scheduling 
concept  called  Time  Estimating  Relationship  (TER).  The  following  material  has 
been  collected  on  their  approach.  Part  of  this  description  is  from  a  report  by 
LA  McNally  of  ASD/PMDPM  at  Wright-Patterson  AFB. 

The  objectives  of  TERs  are  based  on  the  assumption  that  certain 
performance/physical  parameters  were  linked,  thru  the  cause/effect  mechanism, 
with  time  required,  and  that  the  re1ationship--parameters  and  time,  could  be 
displayed  in  a  mathematical  framework  to  demonstrate  the  feasibility  of  devel¬ 
oping  time  estimating  relationships. 

This  approach  includes  the  following  steps: 

a.  Gather  and  assimilate  data, 

b.  Evaluate  possible  parameters, 

c.  Use  data  in  multiple  regression  analysis, 

d.  Review  and  analyze  multiple  regression  results, 

e.  Select  best  parameters, 

f.  Select  best  equations. 

The  attached  Figures  A7-1  and  A7-2  briefly  illustrate:  (1)  the  statistical 
technique  for  milestone  date  selection,  and  (2)  how  the  statistical  selected 
data  compares  to  milestone  dates  selected  by  conventional  methods. 

A  total  of  ten  parameters  were  used  by  VMSC  to  develop  the  set  of  algorithms. 
Most  of  these  parameters  could  be  deriveo  from  the  system  specification  at  the 
end  of  the  conceptual  phase.  These  parameters  are  applicable  only  to  aircraft 
or  missile  systems.  The  parameters  are: 

a.  Empty  weight, 

b.  Structure  weight, 

c.  Useful  load  to  structure  weight  ratio, 

d.  System  weight  to  empty  weight  ratio, 

e.  Maximum  velocity, 

f.  Thrust  to  weight  ratio, 

g.  Number  of  engines, 

h.  Planform  area, 

1.  Structure  complexity  factor, 
j.  Maximum  exposed  surface  temperature. 

These  parameters  could  not  be  applied  to  ground  based  systems/systems/subsystems 
nor  could  they  be  applied  to  airborne  subsystems. 


FIGURE  A 7-2 

SUMMARY  MASTER  SCHEuULc 


LEGEND:  V  STUDY  DETAIL  SCHEDULES  A  DETAIL  SCHEDULES  ADJUSTED  FOR  O  TER  RESULTS 

ANTICIPATED  GROWTH  AT  1.2  PER  MONTH 


This  set  of  algorithms  ca.i  ta  applied  only  to  aircraft  and  missile  systems 
starting  with  the  initiation  of  tne  validation  phase.  The  VMSC  method  is  not 
applicable  to  the  production  phase  of  a  orogram.  in  addition,  this  method  does 
not  consider  quantity,  unit  cost,  or  production  rates. 

Although  the  VMSC  method  could  prove  to  be  valuable  to  analysis  of  schedules 
for  the  development  phases  of  an  aircraft  or  missile  program,  it  has  several 
deficiencies: 

a.  This  method  does  not  relate  to  program  urgency  or  the  contractor 
experience.  Both  these  factors  will  have  a  definite  bearing  on  how  long  it 
takes  a  contractor  to  perform  tne  tasks  required. 

b.  Another  area  that  needs  attention  if  these  algorithms  are  to  be 
applied  as  is  to  aircraft  or  missile  systems  is  the  data  case.  The  data  needs 
to  be  updated  to  reflect  the  more  recent  programs.  The  equations  should  be 
verified  by  testing  them  against  systems  not  used  in  the  original  data  base. 

The  equations  may  then  need  to  be  refined. 

c.  The  time  durations  between  milestones  are  excessive.  In  order  to 
provide  the  needed  visibility,  more  milestones  should  be  established. 

d.  Additional  parameters  are  needed  to  be  derived  to  establish 
schedules  which  will  be  through  the  production  base. 

If  parametric  scheduling  is  ever  used,  it  must  have  an  adequate  data  base. 

In  a  master  thesis  entitled,  "The  Air  Force  Cost  Estimating  Process:  The 
Agencies  Involved  and  Estimating  Techniques  Used,"  by  Major  Edwin  M.  Lewis  and 
Major  Eugene  D.  Pearson,  the  following  excerpt  deals  with  the  question  of  data 
availability  in  the  Air  Force,  including  a  major  consideration  of  ASD.  Even 
though  the  subject  dealt  with  is  estimating,  the  same  problems  would  effect  sta¬ 
tistical  scheduling. 

Contractor  Proposals  Estimates. 

The  defense  industry  is  composed  of  approximately  22,000  prime  contractors 
and  100,000  subcontractors.  These  contractors  are  used  throughout  the  weapon 
system  acquisition  process  to  support  the  Air  Force  efforts  in  designing  and 
estimating  the  cost  of  new  weapon  systems  as  well  as  producing  the  weapon 
system.  They  provide  technical,  feasibility,  and  cost  studies  to  the  Air  Force 
In  the  conceptual  phase  and  cost  proposals,  budget  estimates  and  cost  perfor¬ 
mance  reports  in  the  conceptual,  validation  and  full-scale  development  phases. 
Cost  estimates  of  the  program's  progress  and  compliance  with  earlier  estimates. 
In  the  form  of  cost  performance  reports,  are  provided  in  the  production  phase. 
These  cost  estimates  are  used  by  the  appropriate  SPO  as  a  basis  for  their  cost 
estimates  and  in  tradeoff  studies  to  determine  which  alternative  system  to 
develop  to  satisfy  the  operational  requirement  and/or  which  design  to  pursue. 

Amount  of  Data  Available 

Professor  Baker,  in  his  doctoral  dissertation,  "Improving  Cost  Estimating 
and  Analysis  in  DOD  and  NASA,"  identified  Historical  Data  Problems  as  a  major 
problem  area  for  estimations.  One  question  in  a  survey  conducted  for  his 
dissertation  requested  information  about  the  principle  problems  of  cost  esti¬ 
mating  perceived  by  persons  In  the  field.  Twenty  three  percent  of  the  1353 
individuals  Involved  In  making  cost  estimates  Indicated  that  problems  related 
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to  the  amount  of  historical  data  available  were  the  most  Important  problems  of 
cost  estimating  and  analysis.  AFSC  responses  to  the  survey  Indicated  26*  (74 
out  of  285)  felt  that  the  data  availability  was  the  most  Important  problem. 

The  problem  grouped  into  the  category  of  Historical  Data  Problems  were: 

1.  data  availability  and  collection  problems, 

2.  lack  of  accurate,  reliable,  credible,  valid,  and  current  data, 

3.  lack  of  data  base  and/or  computerized  data  bank, 

4.  insufficient  data  regarding  installing  and  operating  costs,  and 

5.  Insufficient  data  regarding  recurring  versus  non-recurring  costs. 

Problems  involving  techniques,  tools,  methodology,  and  procedures  were  also 
Identified  as  major  problems  of  cost  estimating  by  26%  of  the  respondents.  The 
specific  problems  Identified  within  this  category  all  involved  a  lack  of 
knowledge  concerning  how  and  when  the  various  techniques,  tools,  methodology, 
and  procedures  should  be  used. 

Captains  Barga  and  Poch  In  their  technical  memorandum  for  the  Air  Force 
Aero-Propulsion  Laboratory  Indicate  that  during  the  conceptual  end  validation 
phases  of  the  acquisition  process,  there  is  often  a  lack  of  adequate,  complete 
or  firm  system  definitions.  The  specifications,  drawings,  and  statements  of 
work  are  not  available  in  detail,  because  the  decision  of  which  alternative 
design  to  use  has  not  yet  been  made.  The  weapon  system  design  is  still 
undergoing  research  and  development.  Because  there  is  a  lack  of  complete  data 
and  only  historical  data  on  analogous  systems  is  available  during  the  conceptual 
and  validation  phases,  a  parametric  approach  to  cost  estimating  should  be  used. 
More  information  becomes  available  during  the  full-scale  development  and  produc¬ 
tion  phases.  Additional  data  on  system  specification  and  performance  require¬ 
ments  become  available  as  the  weapon  system  is  better  defined.  More 
identlf Ication  and  prediction  of  the  information  not  available  is  also  possible 
during  the  full-scale  development  and  production  phases.  For  this  reason, 
more  accurate  methods  of  estimating  weapon  systems  costs  can  be  used.  A 
detailed  engineering  approach  becomes  possible  during  the  full-scale  development 
and  production  phases. 

The  amount  or  level  of  data  available  to  make  cost  estimates,  as  described 
by  Baker  and  Barga  and  Poch  can  be  placed  on  a  continuum  ranging  from  little  or 
no  hard,  factual  data  available  to  a  highly  detailed  level  of  data.  For  the 
purpose  of  this  research,  the  researchers  have  defined  four  categories  of  data 
levels.  These  levels  are  based  on  the  activities  taking  place  in  the  phase  of 
the  weapon  system  acquisition  proces,  i.e.,  as  the  system  progresses  through  the 
acquisition  process,  it  becomes  better  defined  and  moves  from  a  paper  concept 
to  an  actual  item  in  the  Air  Force  inventory.  The  four  levels  of  data  as 
defined  by  the  researchers  are: 

1.  VAGUE— In  the  conceptual  phase,  there  Is  an  almost  complete  absence  of 
factual  cost  data  on  the  specific  system  being  worked.  The  new  weapon  system 
Is  basically  a  paper  system  and  has  not  been  defined  beyond  the  stage  of  a 
requirement  for  a  particular  type  of  weapon  system  to  meet  a  need.  There  Is, 
however,  specific  data  on  other  weapon  systems  available  for  use,  but  the  rela¬ 
tion  to  the  new  weapon  system  is  questionable. 


2.  LIMITED-- In  the  validation  phase,  the  design  of  the  system  begins  to 
take  shape.  More  specific  information  is  available  on  what  the  new  system  will 
be  and  what  the  specifications  of  the  system  are.  Because  this  additional 
Information  Is  available,  a  better  comparison  to  other,  previous  weapon  systems 
can  be  made,  giving  the  estimating  agencies  more,  but  still  limited,  data  on 
which  to  base  their  estimates. 

3.  DETAILED— In  the  full  scale  development  phase,  the  system  Is  completely 
defined  and  the  specifications  finalized.  Prototypes  of  the  weapon  system  are 
developed  for  testing.  It  is  in  this  phase,  that  the  majority  of  detailed  data 
for  making  cost  estimates  becomes  available.  Limited  production  figure  from  the 
prototype  production  are  also  available  for  use. 

4.  HISTORICAL— In  the  production  phase  the  full  production  figures  are 
available  in  the  form  of  cost  performance  reports  and  other  accounting  reports. 

At  this  point,  except  for  changes  in  the  production  schedule  and  future  infla¬ 
tion  rates,  the  actual  cost  of  producing  the  weapon  system  is  easily  and 
accurately  projected. 

Techniques  Used  to  Generate  Cost  Estimates 

One  of  the  cost  estimating  teciinique  categories  is  the  parametric  category  — 
In  this  category  the  cost  estimates  come  from  relationships  which  can  oe 
developed  between  historical  costs,  system  physical  attributes  and/or  perfor¬ 
mance  characteristics.  The  historical  costs  take  into  account  system  growth, 
engineering  changes,  program  stretchouts  and  any  other  possible  difficulties 
encountered  in  comparable  programs.  They  have  valuable  application  when: 

a.  Some  performance/design  parameters  are  known  but  detailed  mechani¬ 
zation  features  are  lacking. 

b.  Gross  estimates  are  acceptable. 

c.  In  the  early  stages  of  program  development. 

d.  Quick  reaction  estimates  are  needed. 

e.  Used  for  cost/performance  trade-off  studies. 

The  cost  estimating  techniques  which  fit  into  this  category  include  analogy, 
CER,  expert  opinion,  list  price,  and  parametric.  There  are  also  other 
approaches  to  statistical  scheduling  such  as  that  done  by  Dr.  R.  L.  Slelken,  Jr. 
and  Dr.  H.  0.  Hartley  of  the  Institute  of  Statistics  at  Texas  A&M  University.  A 
copy  of  their  university  publication  was  acquired  entitled,  "A  New  Statistical 
Approach  to  Project  Scheduling."  If  further  interest  is  seen  in  this  area,  this 
material  should  be  reviewed.  The  work  was  done  under  a  grant  from  the  Office  of 
Naval  Research,  Contract  N000014-68-A-0140,  Project  NR047-70Q. 

B.  Network  Techniques 

Networks  utilize  events  and  activities  diagrams  which  show  the  direction  of 
progress  and  major  interdependencies  between  the  activities.  Networks  can  be 
structured  to  show  the  detail  required  by  the  various  levels  of  Air  Force  or 
contractor  management.  Portions  of  major  tasks  can  also  be  depicted  by  networks 
If  that  amount  of  detail  is  required.  These  techniques  are  designed  for  sched¬ 
uling  activities  In  development  or  one-of-a-kind  operations.  Neither  technique 
Is  particularly  well  suited  for  repetitive  operations. 


1.  Critical  Path  Method 


The  network  concept  of  CPM  Is  an  excellent  device  for  explicitly 
depicting  significant  Interrelationships  among  events.  Since  time  estimates 
lead  to  the  determination  of  a  critical  path  so  that  resources  can  be  applied  or 
reallocated  to  permit  the  schedule  to  be  met.  One  criticism  of  CPM  is  that 
emphasis  on  the  critical  path  activities  may  obscure  the  fact  that  other  paths 
may  be  close  to  being  critical  and  would  become  so  with  slight  changes  in  values 
this  problem  could  be  overcome  by  ranking  the  paths  according  to  the  project 
time  to  complete.  CPM  does  not  provide  the  capability  to  effectively  handle 
schedule  uncertainties.  The  time  estimate  must  represent  the  single  best  esti¬ 
mate  of  the  time  required.  Uncertainty  is  not  reflected  In  terms  of  range  of 
times  If  the  estimates  are  not  accurate  then  the  critical  path  may  oe 
Incorrectly  Identified. 

CPM  TECHNIQUES— STRENGTHS  AND  WEAKNESSES 
CRITERIA  STRENGTHS  WEAKNESSES 


1.  Validity  No  formula  is  provided  to 

estimate  time  to  completion; 
consequently,  the  technique 
is  as  valid  ?s  the  estimator. 
The  margin  of  error  is 
generally  less  In  construc¬ 
tion  than  in  development. 


2.  Reliability 


3.  Implementation 


Numerous  estimates  In  a 
large  project,  each  with  some 
reliability  may  lead  to  sig¬ 
nificant  errors  in  judging 
project  status. 

Relatively  difficult  to 
explain,  especially  If  the 
various  concepts  of  float 
are  utilized. 


4.  Universality  of 
project  coverage 


5.  Sensitivity  Testing 
(simulation) 


6.  Forecasting 


Very  good  for  single¬ 
shot  activities,  such  as 
construction  or  develop¬ 
ment  projects. 


Excellent  for  simulating 
alternative  plans,  especi¬ 
ally  when  coupled  with  the 
time-cost  aspect. 


Weak  in  the  production 
phase  of  a  weapon  life 
cycle.  The  technique  is  not 
well  adapted  to  scheduling 
production  quantities 


Strongly  oriented  to  fore¬ 
casting  ability  to  accomplish 
future  events  on  schedule. 


2.  Program  Evaluation  Review  Technique  (PERT) 

PERT  was  formulated  at  approximately  the  same  time  as  CPM.  The  same 
basic  concepts  of  events,  activities,  and  networks  are  used  in  both  methods. 

The  discussion  of  PERT  will  center  on  the  areas  of  difference  between  the  two 
methods . 

The  major  difference  is  the  treatment  by  PERT  of  schedule  uncertainties. 
PERT  uses  three  time  estimates  to  arrive  at  the  expected  time.  The  first  esti¬ 
mate  is  the  optimistic  time.  This  is  the  ;ime  in  which  the  project  could  be 
completed  more  quickly  only  about  IX  of  the  time.  The  second  estimate  Is  the 
most  likely  time  (the  mode)  to  complete  the  project.  The  third  estimate  is  the 
pessimistic  time,  or  the  time  in  which  a  project  would  take  longer  to  accomplish 
only  about  IX  of  the  time.  The  mean  or  the  expected  time  Is  determined  by 
sumning  the  optimistic,  the  pessimistic  and  4  times  the  most  likely  time.  This 
sum  Is  then  divided  by  6  to  arrive  at  the  expected  time.  The  PERT  time  esti¬ 
mating  offers  some  advantages  over  CPM.  First,  the  estimators  usually  make  more 
valid  estimates  if  they  can  express  the  extent  of  their  uncertainty.  In 
addition,  a  range-of-time  estimate  will  provide  a  more  realistic  and  infor¬ 
mative  picture  of  the  program  than  will  a  single  point.  Another  advantage  Is 
that  a  single  point  estimate  is  likely  to  be  the  mode.  The  mean  Is  considered  to 
be  more  statistically  representative  of  the  distribution  than  the  mode.  The 
mean  is  based  on  all  the  Information  about  the  distribution  rather  than  the 
single  most  frequent  estimate.  One  criticism  of  PERT  is  that  the  three  time 
estimates  are  too  time  consuming  to  develop  and  that  In  most  cases  the  expected 
time  estimates  do  not  vary  significantly  from  the  single  point  estimate  and 
therefore  are  not  justified. 

PERT  TECHNIQUE-STRENGTHS  AND  WEAKNESSES 


CRITERIA 
1.  Validity 


STRENGTHS 

PERT,  like  CPM,  is  cap¬ 
able  of  depicting  work 
sequence.  The  use  of 
three  time  estimates 
should  make  it  more  valid 
than  any  other  technique. 


WEAKNESSES 


2.  Reliability 


3.  Implementation 


Universality 
of  Project 
Coverage 


Very  strong  In  devel¬ 
opment  phase. 


On  the  other  hand,  securing 
three  time  estimates  for  each 
activity  requires  more  Informa¬ 
tion  which  tends  to  Introduce 
additional  error. 

The  complete  PERT  system  Is 
quite  complex  and  therefore 
difficult  to  Implement. 

Requires  adaptation  for 
application  to  production 
operations. 


CRITERIA 


STRENGTHS 


WEAKNESSES 


5.  Sensitivity 
(simulation) 


6.  Forecasting 


Since  PERT  Is  usually 
mechanized.  It  has  good 
potential  for  simulating 
the  impact  of  various 
resource  allocations  on 
the  schedule,  or  the 
various  ways  of  sequencing 
work. 

PERT  Is  strongly  oriented  to 
forecasting  the  ability  to 
accomplish  future  events  on 
schedule. 


3.  Line  of  Balance 


The  Line  of  Balance  technique  (LOB)  was  developed  to  improve  scheduling 
and  status  reporting  in  an  ongoing  production  process.  It  is  a  technique  for 
assembling,  selecting,  interpreting  and  presenting  in  a  graphic  form  the  essen¬ 
tial  factors  Involved  in  a  production  process  from  raw  materials  to  completion 
of  the  product  against  time.  As  a  planning  tool,  it  helps  to  integrate  the  flow 
of  materials  and  components  which  go  into  the  manufacture  of  end  items  in  accor¬ 
dance  with  phased  delivery  requirements.  The  LOB  identifies  relationships  be¬ 
tween  various  elements  of  the  manufacturing  process  and  can  be  used  to  identify 
deficiencies  in  the  availability  of  subcontract  elements,  materials,  parts,  and 
assemblies  at  selected  control  points  along  the  production  line. 

The  LOB  technique  uses  four  essential  elements: 

The  objective 

The  program  or  manufacturing  plan 
Program  process 
The  line  of  balance 


The  Objective.  The  first  step  in  using  the  LOB  technique  is  the  establishment 
of  the  objective.  The  objective  of  a  production  process  is  to  meet  the  required 
delivery  schedule  both  for  a  specified  period  and  cumulatively.  The  data  used 
In  the  objective  shows  both  planned  (contract  requirements)  and  actual 
deliveries.  The  chart  portrayal  of  the  objective  is  accomplished  by  using  a 
simple  graph  which  displays  the  cumulative  delivery  requirements  against  time. 
Actual  deliveries  are  plotted  on  the  seme  graph. 

The  Program.  Charting  of  the  program  on  the  manufacturing  plan  Is  the  second 
step  In  establishing  the  LOB.  This  comprises  the  stages  In  producers  planning 
where  key  manufacturing  operations  or  assembly  points  are  Identified. 


r\ 


CRITERIA  STRENGTHS 

1.  Validity  Uncertainties  surrounding 

completion  times  In  pro¬ 
duction  operations  are 
minimal;  consequently 
LOB  affords  management  a 
sound  technique  for 
judging  status  of  opera¬ 
tions. 


2.  Reliability  Compares  favorably  with 

Gantt  technique 

3.  Implementation  Only  slightly  more  diffi¬ 

cult  to  comprehend  and  to 
implement  than  Gantt 
technique. 


4.  Universality  Capable  of  covering  a 

of  project  system  life  cycle 

coverage 


5.  Sensitivity 
testing 
(simulation) 


6.  Forecasting  Depicts  status  of  pro¬ 
ject  well  in  production 
stage  arid  can  forecast 
whether  or  not  schedule 
will  be  met. 


WEAKNESSES 

Uncertainties  encountered 
In  the  development  phase 
Impair  judcpnent  on  actual 
project  status.  The 
techniques  for  estimation 
of  percent  completion  can 
lead  to  erroneous  decisions 
concerning  project  develop¬ 
ment. 


Does  not  emphasize  resource 
allocation  directly. 


No  significant  capability 
for  simulating  alternative 
courses  of  action. 

Offers  no  technique  to 
handle  uncertainty  in 
development  phase. 


Figure  A7-3  Illustrates  the  Network  concept  and  Figure  A7-4  Illustrates  how  the 
network  can  be  done  at  different  levels. 


C.  Milestone  Techniques 

The  Gantt  technique  was  the  first  formal  scheduling  system  to  be  used  by 
management.  The  cornerstone  of  the  technique  is  the  Gantt  chart,  which  Is  basi¬ 
cally  a  bar  chart  showing  planned  and  actual  performance  for  those  resources 
that  management  desires  to  control.  In  addition,  major  factors  that  create 
variance  (l.e.,  overproduction  or  underproduction)  are  coded  and  depicted  on  the 
chart.  The  Gantt  chart  was  designed  for,  and  Is  most  successfully  applied  to, 
highly  repetitive  production  operations.  Normally,  it  assumes  that  time  stan¬ 
dards  are  available  for  each  operation  and  that  the  objective  of  management  Is 
to  obtain  "normal"  output  from  each  major  resource  employed,  especially  labor 
and  machinery. 

The  milestone  scheduling  system  is  based  largely  on  the  same  principles  as 
the  Gantt  system  but  the  technique  of  displaying  project  status  differs.  The 
milestone  system  Is  usually  applied  to  development  projects  and  is  frequently 
used  at  several  of  the  higher-management  levels,  for  example,  corporate,  SPO, 
AFSC,  and  Hq  USAF.  A  milestone  represents  an  Important  event  along  the  path  to 


The  Figure  below  depicts  hypothetical  network  of  a  highly 
compressed  and  simplified  Interpretation  of  activities 


4- 6  Long  Lead  Materials 

5- 6  Prototype  Fabrication  and  Assembly' 

5- 7  Structural  Fatigue  Tests 

6- 7  Gun  and  Ammo  Qualification  Tests* 

7- 8  Production  of  First  Article* 


NETWORK  LEVELS 


project  completion.  All  milestones  are  not  equally  significant.  The  most 
significant  are  termed  "major  milestones"  usually  representing  the  completion  of 
an  Important  group  of  activities.  In  reality,  of  course,  there  are  many  grada¬ 
tions  of  Importance. 


MILESTONE 


CRITERIA 

STRENGTHS 

WEAKNESSES 

Validity 

Good  in  production  oper- 
tlons.  Because  of  short 
time  duration  of  each 
measured  operation,  only 
small  errors  in  measure¬ 
ment  are  likely  to  occur. 

No  explicit  technique 
for  depicting  inter¬ 
relationships,  which 
are  especially  Important 
in  development. 

Reliability 

Simplicity  of  system 
affords  some  reliability. 

Frequently  unreliable, 
especially  in  development 
stage,  because  judgment  of 
estimator  may  change  over 
time.  Numerous  estimates 
in  a  large  project,  each 
with  some  unre’ ia_ . 1 ity, 
may  lead  to  errors  in  judging 
status. 

Implementation 

Easiest  of  all  systems 
in  some  respects 
because  it  is  well  under¬ 
stood  (System  implies 
existence  of  time 
standards.) 

Quite  difficult  to  implement 
for  the  control  of  operations 
in  development  phase,  where 
time  standards  do  not 
ordinarily  exist  and  must  be 
developed. 

Universality  of 

Project 

coverage 

Can  comprehensively  cover 
a  given  phase  of  a  life 
cycle.  Effective  at  the 
resource  or  input  level 
of  control. 

Less  useful  in  definition 
and  development  phases  of 
life  cycle. 

Sensitivity 

Testing 

(simulation) 

No  significant  capability. 

Forecasting 

In  production  operation, 
good  technique  to  assess 
ability  to  meet  schedule 
on  a  given  activity  if 
based  on  good  time 
standards. 

Weak  in  forecasting 
ability  to  meet  schedule 
when  interrelationships 
among  activities  are 
involved. 

The  list  of  90  milestones  were  being  considered  by  an  ASD/SPO  in  order  to 
adequately  measure  their  schedule  performance. 

Figure  A7-5  Illustrates  what  can  be  done  with  an  automated  milestone  status 
chart . 
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